-- Logs begin at Thu 2021-09-02 03:37:54 UTC, end at Thu 2021-09-02 04:50:57 UTC. -- Sep 02 04:21:06.654944 dv-cinder-804735-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 04:21:06.662418 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 2 04:21:06 2021] *** Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: nodename: dv-cinder-804735-7-iscsi Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: machine: x86_64 Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: clock source: unix Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: pcre jit disabled Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: detected number of CPU cores: 4 Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: current working directory: / Sep 02 04:21:06.666177 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: detected binary path: /usr/bin/uwsgi-core Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: your processes number limit is 47680 Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: your memory page size is 4096 bytes Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: detected max file descriptor number: 2048 Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: lock engine: pthread robust mutexes Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: thunder lock: enabled Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 04:21:06.666875 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 02 04:21:06.710471 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: Python main interpreter initialized at 0x559a994ec9c0 Sep 02 04:21:06.710471 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: python threads support enabled Sep 02 04:21:06.710471 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: your server socket listen backlog is limited to 100 connections Sep 02 04:21:06.710471 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: your mercy for graceful operations on workers is 90 seconds Sep 02 04:21:06.710781 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 04:21:06.710856 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: *** Operational MODE: preforking *** Sep 02 04:21:06.711130 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: *** uWSGI is running in multiple interpreter mode *** Sep 02 04:21:06.711130 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: spawned uWSGI master process (pid: 93707) Sep 02 04:21:06.711309 dv-cinder-804735-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 04:21:06.713537 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: spawned uWSGI worker 1 (pid: 93708, cores: 1) Sep 02 04:21:06.713537 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: spawned uWSGI worker 2 (pid: 93709, cores: 1) Sep 02 04:21:06.713941 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 04:21:08.335901 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:21:08.335901 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: from cryptography.utils import int_from_bytes Sep 02 04:21:08.336473 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:21:08.336473 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: from cryptography.utils import int_from_bytes Sep 02 04:21:08.337079 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:21:08.337079 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: from cryptography.utils import int_from_bytes Sep 02 04:21:08.337552 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:21:08.337552 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: from cryptography.utils import int_from_bytes Sep 02 04:21:11.009002 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 04:21:11.009659 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 04:21:11.009754 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 04:21:11.010051 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 04:21:11.010307 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 04:21:11.010691 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.011020 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.011340 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.011499 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 04:21:11.011864 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.012002 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 04:21:11.012104 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.012231 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 04:21:11.012336 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.012596 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 04:21:11.012729 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.012850 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 04:21:11.012941 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013225 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013316 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013487 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013584 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013801 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.013900 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014125 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-7-iscsi {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014229 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014457 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014555 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014758 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.014855 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015064 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015150 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015380 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015475 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015681 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015783 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.015964 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016056 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016277 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016364 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016600 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-7-iscsi {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016803 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.016909 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017217 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017319 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017525 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017631 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017834 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.017928 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018143 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018244 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018447 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018558 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018754 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.018852 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019071 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019251 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019361 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019559 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019687 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.019863 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020024 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020197 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020417 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-7-iscsi {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020530 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020735 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.020824 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021054 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021150 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021365 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021461 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021726 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.021814 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.022047 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.022678 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.022872 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.022972 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023189 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023290 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-7-iscsi {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023517 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023617 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023822 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.023961 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024175 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024263 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024508 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024664 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024841 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.024962 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025147 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025247 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025442 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025546 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025751 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.025844 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026060 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026152 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026383 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026485 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026680 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026772 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.026985 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027078 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027229 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027319 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027540 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027642 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027863 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.027989 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028191 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028283 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028508 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028609 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028755 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.028965 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029057 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029128 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029313 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029414 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029623 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029724 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.029927 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030026 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030236 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030336 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030540 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030642 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030788 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.030892 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031038 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031129 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031352 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031451 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031668 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031766 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.031992 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032095 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032302 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032392 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032605 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032700 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.032913 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033015 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033217 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033312 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033520 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033620 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033821 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.033921 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034319 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034461 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034651 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034797 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.034938 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035093 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035234 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035381 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035523 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035740 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.035897 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036060 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036213 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036354 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036494 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036642 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036791 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.036938 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037078 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037217 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037364 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037652 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.037828 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.038496 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.038639 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.038778 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.038955 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039119 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039370 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039522 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039669 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039810 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.039997 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040152 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040293 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040433 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040578 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040718 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.040718 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041002 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041157 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041307 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041447 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041586 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041734 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.041881 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042021 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042160 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042298 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042444 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042593 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042734 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.042879 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043029 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043213 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043362 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043515 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043655 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043795 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.043953 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044100 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044255 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044402 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044542 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044681 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044820 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.044969 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045118 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045259 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045404 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045553 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045716 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.045930 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046160 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046303 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046442 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046588 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046734 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.046875 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047033 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047173 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047312 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047452 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047599 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047739 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.047887 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048143 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048285 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048423 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048562 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048701 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.048852 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049003 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049152 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049292 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049437 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049583 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049732 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.049872 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050012 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050151 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050289 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050429 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050576 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050730 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.050879 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051072 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051218 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051367 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051507 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051646 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051785 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.051941 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052087 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052244 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052385 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052524 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052679 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052820 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.052965 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053113 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053254 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053393 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053532 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053677 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053817 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.053965 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.054105 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.054245 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.054384 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.054533 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.054533 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.054816 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.054956 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.055101 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.055242 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.055380 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.055530 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:21:11.055670 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.055816 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056087 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056236 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056385 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056544 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056692 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056838 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.056979 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057117 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057257 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057257 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057543 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057683 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057828 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.057966 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058117 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058267 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058415 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058561 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058700 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058700 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.058980 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059127 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059273 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059452 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059617 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059768 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.059928 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060091 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060243 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060390 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060531 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060670 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060826 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.060970 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061109 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061248 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061387 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061527 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061713 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061858 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.061998 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062148 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062295 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062440 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062590 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062737 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.062877 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063016 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063155 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063294 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063442 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063582 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063722 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.063883 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064061 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064215 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064355 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064494 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064632 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064773 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.064910 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065082 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065230 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065392 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065539 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065685 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065836 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.065990 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.066215 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.066369 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.066509 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.066648 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.066788 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067007 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067157 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067297 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067446 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067587 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067735 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.067887 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068069 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068069 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068335 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068475 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068625 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068772 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.068921 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.069572 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.069714 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.069854 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070005 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070145 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070295 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070435 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070574 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070713 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.070872 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071018 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071157 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071296 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071435 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071574 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071722 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.071869 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072061 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072212 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072352 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072643 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072791 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.072930 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073077 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073217 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073365 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073506 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073645 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.073932 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074116 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074275 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074458 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074614 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074761 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.074902 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075076 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075231 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075402 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075548 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075723 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.075871 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076053 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076235 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076446 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076591 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076741 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.076881 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077021 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077169 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077310 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077450 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077590 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077736 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.077876 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078028 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078189 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078331 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078478 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078627 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078767 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.078919 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079060 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079199 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079339 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079479 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079618 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079766 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.079967 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080265 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080406 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080569 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080708 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080848 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.080987 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081134 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081281 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081430 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081572 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081718 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.081864 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082013 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082152 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082301 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082449 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082597 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082737 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.082877 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083016 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083164 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083304 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083444 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083583 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083723 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.083872 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.084074 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.084223 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.084375 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.084516 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.085237 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.085401 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.085543 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.085684 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.085856 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086003 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086165 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086321 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086492 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086710 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.086865 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087013 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087154 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087306 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087447 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087593 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087734 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.087874 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088075 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088361 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088510 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088671 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088813 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.088953 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089098 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089248 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089395 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089535 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089674 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089813 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.089966 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090107 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090246 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090385 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090539 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090679 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090831 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.090980 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091132 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091287 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091427 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091566 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091715 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.091866 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092044 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092194 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092346 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092486 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092635 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092781 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.092921 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093061 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093208 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093354 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093503 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093644 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093784 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.093922 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094070 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094229 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094377 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094517 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094656 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094802 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.094943 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095092 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095240 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095379 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095518 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095658 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.095803 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096045 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096204 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096345 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096484 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096624 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096817 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.096972 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097113 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097254 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097393 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097590 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097742 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.097883 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098023 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098173 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098338 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098548 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098707 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098849 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.098988 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099134 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099274 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099420 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099574 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099714 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.099853 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100046 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100198 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100339 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100490 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100637 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100777 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.100916 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101072 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101223 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101374 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101514 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101654 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101794 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.101933 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.102241 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.102388 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.102567 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.102714 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.102878 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103090 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103248 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103472 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103619 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.103899 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104132 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104295 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104454 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104596 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104735 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.104876 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105022 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105175 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105323 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105462 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105610 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.105932 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106095 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106237 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106387 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106528 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106676 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106847 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.106994 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.107162 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.107471 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.107616 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.107781 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108116 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108265 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108427 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108666 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108814 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.108962 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109116 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109257 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109405 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109594 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109740 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.109954 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110122 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110273 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110419 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110586 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110738 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.110889 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111030 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111176 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111357 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111692 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.111854 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112036 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112177 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112342 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112482 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112636 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112809 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.112953 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113092 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113238 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113391 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113551 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113700 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.113855 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114042 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114202 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114373 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114535 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114683 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.114854 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.115036 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.115192 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.115339 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.115502 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.115969 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116118 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116258 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116397 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116537 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116688 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116828 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.116979 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117120 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117260 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117399 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117548 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117695 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117836 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.117976 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118276 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118416 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118565 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118790 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.118947 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119095 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119244 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119391 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119391 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119667 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119813 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.119974 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120120 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120261 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120412 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120560 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120707 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.120866 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121084 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121233 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121375 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121523 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121670 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121818 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.121968 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122109 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122255 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122405 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122553 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122708 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.122864 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123005 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123167 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123309 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123463 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123646 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.123801 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124001 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124165 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124313 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124460 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124614 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124760 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.124932 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125089 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125236 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125381 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125528 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125674 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125827 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.125991 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126145 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126292 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126446 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126593 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126757 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.126911 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127058 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127203 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127358 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127503 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127663 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127810 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.127986 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.128145 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.128292 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.128446 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.128609 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.128789 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129017 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129170 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129325 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129471 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129626 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129775 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.129920 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130082 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130237 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130391 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130557 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130705 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.130866 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.131021 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.131176 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.131332 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.131480 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132160 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132307 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132461 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132615 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132781 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.132929 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133076 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133222 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133386 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133548 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133713 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.133870 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134017 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134169 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134316 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134470 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134625 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134815 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.134974 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135121 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135275 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135432 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135588 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135743 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.135896 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136072 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136219 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136390 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136546 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136707 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.136863 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137010 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137156 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137320 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137479 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137640 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137794 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.137948 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138095 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138259 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138414 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138575 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138729 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.138876 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139045 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139276 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139429 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139586 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139742 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.139896 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140107 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140258 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140404 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140559 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140713 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.140859 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141021 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141168 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141324 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141470 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141635 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141781 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.141982 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142136 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142283 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142437 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142599 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142762 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.142926 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143082 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143227 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143227 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143513 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143513 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143821 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.143991 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144151 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144298 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144446 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144601 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144748 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.144909 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145063 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145222 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145378 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145556 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145704 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145851 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.145997 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146151 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146300 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146468 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146624 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146780 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.146926 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147080 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147300 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147464 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147624 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147772 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.147941 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148095 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148241 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148408 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148565 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148719 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.148865 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149018 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149174 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149408 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149561 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149720 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.149867 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150028 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150257 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150407 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150560 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150708 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.150854 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151015 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151179 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151326 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151480 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151641 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151809 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.151977 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152147 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152296 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152457 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152613 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152761 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.152918 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153075 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153221 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153375 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153538 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153684 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153850 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.153999 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154162 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154325 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154481 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154628 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154628 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.154919 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155066 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155212 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155359 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155505 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155661 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.155852 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156046 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156195 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156342 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156487 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156645 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156794 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.156949 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157096 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157243 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157398 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157545 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157703 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.157878 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158027 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158174 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158174 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158466 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158613 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.158905 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159053 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159053 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159344 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159344 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159761 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.159761 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160110 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160267 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160414 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160561 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160707 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.160853 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161012 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161161 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161307 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161454 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161600 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161936 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.161936 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.162227 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.162374 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.162520 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.162666 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.163353 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.163505 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.163652 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.163799 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.163967 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164130 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164302 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164477 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164627 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164774 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.164921 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165074 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165231 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165379 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165531 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165679 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165826 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.165981 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166144 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166291 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166461 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166610 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166756 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.166910 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167058 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167204 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167350 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167651 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.167806 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168000 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168167 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168314 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168469 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168625 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168780 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.168927 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169080 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169233 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169381 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169537 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169769 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.169922 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170075 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170234 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170382 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170540 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170688 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.170834 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171000 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171160 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171308 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171455 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171608 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171765 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.171945 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172098 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172256 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172403 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172559 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172724 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.172873 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173027 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173175 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173322 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173468 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173624 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173773 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.173920 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174066 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174223 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174370 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174526 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174687 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174836 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.174983 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175130 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175286 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175440 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175587 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175740 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.175896 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176117 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176286 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176435 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176584 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176737 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.176893 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177041 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177196 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177344 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177490 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177637 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177783 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.177930 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178095 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178244 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178413 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178597 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178746 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.178900 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179057 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179205 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179351 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179497 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179644 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.179815 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180059 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180227 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180375 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180375 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180655 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180810 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.180957 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181112 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181259 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181405 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181552 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181708 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.181854 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182001 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182159 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182159 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182464 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182616 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182769 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.182917 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183063 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183211 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183367 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183515 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183661 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183808 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.183976 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184150 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184309 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184457 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184610 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184758 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.184904 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185050 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185206 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185355 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185500 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185500 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185787 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.185934 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186102 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186257 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186405 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186405 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186690 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186690 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.186978 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187124 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187270 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187418 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187564 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187719 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.187877 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188074 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188233 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188388 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188535 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188691 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188839 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.188985 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189137 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189285 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189431 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189626 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189775 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.189935 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190165 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190319 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190466 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190624 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190772 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.190919 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191067 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191214 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191369 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191517 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191664 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191810 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.191989 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192143 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192305 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192466 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192619 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192766 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.192912 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193060 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193060 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193355 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193511 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193660 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193806 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.193963 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.194651 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.194800 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.194800 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195085 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195232 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195388 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195541 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195689 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.195837 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196012 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196161 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196334 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196494 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196642 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196790 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.196944 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197090 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197311 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197462 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197609 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197764 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.197913 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198069 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198224 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198384 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198531 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198685 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.198839 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199001 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199149 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199295 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199446 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199594 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199749 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.199897 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200095 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200326 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200490 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200638 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200793 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.200941 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201089 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201245 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201392 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201538 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201694 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.201849 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202007 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202162 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202310 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202465 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202613 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.202912 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203069 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203216 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203372 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203528 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203675 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.203822 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204047 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204150 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204318 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204408 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204500 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204604 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204604 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204760 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204760 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204885 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.204885 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205013 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205084 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205162 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205233 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205327 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205396 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205464 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205532 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205613 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205684 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205759 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205834 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205903 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.205971 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206048 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206117 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206192 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206266 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206336 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206336 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206467 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206535 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206602 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206677 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206771 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206875 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.206991 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.207181 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.207490 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.207592 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.207799 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.207900 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.208125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.208280 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.208448 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.208597 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.208756 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209060 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209149 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209378 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209472 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209734 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.209833 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210157 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210247 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210489 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210617 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210809 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.210912 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211118 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211207 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211447 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211543 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211755 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.211857 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212099 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212190 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212417 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212507 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212729 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.212832 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213030 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213119 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213336 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213432 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213644 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213734 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.213948 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214044 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214249 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214337 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214557 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214647 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214859 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.214947 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215157 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215245 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215467 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215564 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215769 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.215860 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216102 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216192 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216410 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216499 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216714 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.216802 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217015 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217105 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217318 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217408 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217618 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217706 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.217924 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218023 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218226 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218314 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218526 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218613 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218829 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.218925 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219130 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219218 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219432 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219519 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219732 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.219829 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220065 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220157 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220369 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220458 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220677 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220782 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.220978 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221067 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221295 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221385 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221592 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221689 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221896 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.221991 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222209 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222298 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222515 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222604 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222832 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.222927 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.223142 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.223230 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.223451 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.223682 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.223781 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224047 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224142 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224388 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224635 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224727 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.224969 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.225066 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.225832 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.225932 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226173 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226264 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226485 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226573 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226804 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.226904 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227111 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227211 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227416 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227505 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227724 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.227820 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228055 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228145 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228366 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228462 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228672 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228769 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.228978 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229065 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229283 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229371 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229589 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229686 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229893 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.229981 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230200 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230288 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230595 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230810 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.230910 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231141 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231236 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231459 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231549 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231767 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.231862 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232099 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232188 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232410 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232500 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232714 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.232801 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233021 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233124 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233329 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233420 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233634 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233724 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.233946 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234043 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234269 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234358 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234582 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234672 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234884 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.234984 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.235282 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.235377 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.235596 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.235686 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.235948 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236054 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236252 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236342 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236564 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236653 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236883 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.236980 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237190 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237278 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237500 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237594 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237820 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.237911 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238128 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238217 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238458 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238547 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238768 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.238858 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239078 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239183 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239388 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239496 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239698 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.239788 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.240091 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.240182 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.240399 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.240501 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.241499 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.241599 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.241839 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.241942 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242155 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242254 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242480 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242570 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242791 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.242880 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243112 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243211 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243422 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243510 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243732 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.243819 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244071 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244161 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244387 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244478 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244696 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.244798 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245010 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245107 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245313 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245402 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245620 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245708 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.245925 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246065 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246233 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246322 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246539 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246629 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246849 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.246940 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.247173 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.247261 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.247494 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.247694 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.247792 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248022 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248134 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248344 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248620 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248722 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.248945 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249042 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249262 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249352 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249573 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249672 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249880 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.249969 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250193 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250282 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250504 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250593 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250812 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.250902 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251123 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251213 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251436 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251527 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251753 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.251843 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252104 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252204 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252428 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252518 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252752 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.252842 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.253080 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.253178 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.253410 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.253499 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.253655 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 04:21:11.253744 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.254052 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.254380 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:21:11.254623 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 04:21:11.276889 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_db.sqlalchemy.engines [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.278138 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.451631 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.context [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07406424-ea1b-4403-9f17-071fba3928c0(cell1) {{(pid=93708) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 04:21:11.452125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.context [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07406424-ea1b-4403-9f17-071fba3928c0(cell1) {{(pid=93709) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 04:21:11.456106 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:21:11.456519 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_concurrency.lockutils [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:21:11.457670 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:21:11.464125 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_concurrency.lockutils [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:21:11.464244 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:21:11.464331 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_concurrency.lockutils [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:21:11.464413 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:21:11.464495 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_concurrency.lockutils [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:21:11.470924 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_db.sqlalchemy.engines [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.472234 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.474342 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.479105 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_db.sqlalchemy.engines [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.734042 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:11.736716 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_db.sqlalchemy.engines [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:21:12.156490 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: WARNING keystonemiddleware.auth_token [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:21:12.163274 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: WARNING keystonemiddleware.auth_token [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:21:12.169567 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: WARNING keystonemiddleware.auth_token [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:21:12.176049 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: WARNING keystonemiddleware.auth_token [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:21:12.510309 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: WARNING keystonemiddleware.auth_token [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:21:12.515491 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: WARNING keystonemiddleware.auth_token [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:21:12.520670 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a994ec9c0 pid: 93709 (default app) Sep 02 04:21:12.521415 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: WARNING keystonemiddleware.auth_token [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:21:12.522794 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:21:12.524003 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 Sep 02 04:21:12.524680 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 789 bytes} [Thu Sep 2 04:21:12 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:21:12.526536 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: WARNING keystonemiddleware.auth_token [None req-04f6b5ce-ce9c-487d-a97c-5f5b542a46a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:21:12.531810 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a994ec9c0 pid: 93708 (default app) Sep 02 04:22:34.667253 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:34.668484 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Sep 02 04:22:34.669064 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:35.081333 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-723c608c-eecf-492b-a673-a1d383b7acc6 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:35.111066 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-723c608c-eecf-492b-a673-a1d383b7acc6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.434306 Sep 02 04:22:35.111728 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Sep 2 04:22:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:37.369113 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:37.370108 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-dbcf0f04-e955-43a9-adf0-bfc5455f54aa None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Sep 02 04:22:37.370519 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:37.434366 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-bc8aca5f-aa6a-489f-bd67-7214a4ae4997 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:37.452893 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:22:37.452893 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:22:37.535456 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-bc8aca5f-aa6a-489f-bd67-7214a4ae4997 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.158464 Sep 02 04:22:37.536024 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:22:37.752102 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-7d97a1d9-be00-4537-b25c-f69458fb4e9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:37.754482 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:22:37.754482 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: warnings.warn(msg) Sep 02 04:22:37.864348 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-7d97a1d9-be00-4537-b25c-f69458fb4e9f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.319209 Sep 02 04:22:37.864858 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Sep 2 04:22:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:40.080837 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-bc8aca5f-aa6a-489f-bd67-7214a4ae4997 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:40.081931 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-bc8aca5f-aa6a-489f-bd67-7214a4ae4997 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 02 04:22:40.082322 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:40.205181 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4d95562f-0507-4976-b351-937faba77c13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:40.224097 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:22:40.224097 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: warnings.warn(msg) Sep 02 04:22:40.332940 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4d95562f-0507-4976-b351-937faba77c13 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.243887 Sep 02 04:22:40.333865 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:22:40.346424 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-96807e7b-232c-405d-b958-cc421ed40c1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:40.348746 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:22:40.348746 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:22:40.434073 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-96807e7b-232c-405d-b958-cc421ed40c1d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091286 Sep 02 04:22:40.434929 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Sep 2 04:22:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:42.633985 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4d95562f-0507-4976-b351-937faba77c13 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:42.634973 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4d95562f-0507-4976-b351-937faba77c13 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 02 04:22:42.635364 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:42.697554 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-e16cade5-a689-4bb6-8594-7e392824bf66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:42.768868 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-e16cade5-a689-4bb6-8594-7e392824bf66 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125862 Sep 02 04:22:42.768868 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:22:42.780875 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-e2ccf20b-c488-4a40-88f1-66937695c52d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:42.858637 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-e2ccf20b-c488-4a40-88f1-66937695c52d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081320 Sep 02 04:22:42.859251 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Sep 2 04:22:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:22:45.064326 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-e16cade5-a689-4bb6-8594-7e392824bf66 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:45.065372 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-e16cade5-a689-4bb6-8594-7e392824bf66 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Sep 02 04:22:45.072679 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:45 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:45.146507 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-cb81d363-faa2-4f70-883e-feac666688ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:45.232027 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-cb81d363-faa2-4f70-883e-feac666688ad admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158083 Sep 02 04:22:45.232526 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:22:45.245998 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-da173c21-d107-459b-8a98-8183663d61cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:45.329042 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-da173c21-d107-459b-8a98-8183663d61cc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087480 Sep 02 04:22:45.329620 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Sep 2 04:22:45 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:47.610349 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-cb81d363-faa2-4f70-883e-feac666688ad admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:47.611364 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-cb81d363-faa2-4f70-883e-feac666688ad admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 02 04:22:47.611765 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:47.671275 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "disk": 20}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:47.763739 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144816 Sep 02 04:22:47.764469 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:22:47.777362 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-f04378eb-b8d7-4ebe-a786-d471a4f5717d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:47.900016 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-f04378eb-b8d7-4ebe-a786-d471a4f5717d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126216 Sep 02 04:22:47.900654 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Sep 2 04:22:47 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:50.144726 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:50.145723 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 02 04:22:50.146117 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:50.206030 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4782da6f-0703-4701-82b1-30939e0db6cd admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:50.229373 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4782da6f-0703-4701-82b1-30939e0db6cd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076534 Sep 02 04:22:50.229903 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Sep 2 04:22:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:22:52.411076 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:52.412117 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-cf769cad-2409-4d0e-a4c2-6b8385cab786 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 02 04:22:52.412512 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:52.474885 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-c7e3b42e-ad1c-4323-b6d5-743588bb9d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:52.545160 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-c7e3b42e-ad1c-4323-b6d5-743588bb9d44 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.125948 Sep 02 04:22:52.545753 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:22:52.559301 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-a2ee3dd8-371a-49c5-9191-25d83b920af5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:52.649716 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-a2ee3dd8-371a-49c5-9191-25d83b920af5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094904 Sep 02 04:22:52.653108 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Sep 2 04:22:52 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:54.826840 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-c7e3b42e-ad1c-4323-b6d5-743588bb9d44 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:54.827842 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-c7e3b42e-ad1c-4323-b6d5-743588bb9d44 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 02 04:22:54.828267 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:54.885678 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-fe46578c-7e7c-4bb1-b2ab-50c1d852ad8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:54.965334 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-fe46578c-7e7c-4bb1-b2ab-50c1d852ad8f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130617 Sep 02 04:22:54.965895 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:22:54.979093 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-6d04e550-43f5-4fea-9fab-8cc47b52783a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:55.060564 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-6d04e550-43f5-4fea-9fab-8cc47b52783a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085016 Sep 02 04:22:55.061055 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Sep 2 04:22:54 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:57.297222 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-fe46578c-7e7c-4bb1-b2ab-50c1d852ad8f admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:57.298270 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-fe46578c-7e7c-4bb1-b2ab-50c1d852ad8f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 02 04:22:57.298843 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:57.356588 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-9402881e-0efe-4ca9-8526-621521dbe7e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "3", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:57.485003 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-9402881e-0efe-4ca9-8526-621521dbe7e4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.179704 Sep 02 04:22:57.485484 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:57 2021] POST /compute/v2.1/flavors => generated 406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:22:57.497949 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-9d4e0df8-ebcc-4434-814c-1656e8128861 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:57.584799 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-9d4e0df8-ebcc-4434-814c-1656e8128861 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090439 Sep 02 04:22:57.585384 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Sep 2 04:22:57 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:22:59.791498 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-9402881e-0efe-4ca9-8526-621521dbe7e4 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:22:59.792602 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-9402881e-0efe-4ca9-8526-621521dbe7e4 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Sep 02 04:22:59.793178 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:22:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:22:59.852562 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-991186b9-5cfa-494e-a8c5-6c971db3b01e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "id": "4"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:59.960151 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-991186b9-5cfa-494e-a8c5-6c971db3b01e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.160662 Sep 02 04:22:59.973368 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-a4e5d91f-ae6a-458e-98ba-67a10c9d3a35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:22:59.977260 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:22:59 2021] POST /compute/v2.1/flavors => generated 405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:23:00.054114 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-a4e5d91f-ae6a-458e-98ba-67a10c9d3a35 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084326 Sep 02 04:23:00.064110 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Sep 2 04:22:59 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:23:02.280551 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-991186b9-5cfa-494e-a8c5-6c971db3b01e admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:02.281571 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-991186b9-5cfa-494e-a8c5-6c971db3b01e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 02 04:23:02.281966 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:23:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:02.342366 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "id": "5", "swap": 0, "rxtx_factor": 1.0}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:02.438395 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.149993 Sep 02 04:23:02.438959 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Sep 2 04:23:02 2021] POST /compute/v2.1/flavors => generated 408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:23:02.452047 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-79a36cd1-b318-48e0-ab9c-64f3cd231017 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:02.541141 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-79a36cd1-b318-48e0-ab9c-64f3cd231017 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092685 Sep 02 04:23:02.541729 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Sep 2 04:23:02 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:23:41.983583 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:41.984619 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 02 04:23:41.985604 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:23:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:42.041813 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-91f7f158-c88b-477f-8f63-ab1e685bb5a9 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:42.059893 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-91f7f158-c88b-477f-8f63-ab1e685bb5a9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067880 Sep 02 04:23:42.060434 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Sep 2 04:23:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:23:43.494668 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:43.495655 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-4bd7faca-f1d6-4bc2-a4bc-fd30fd31493d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Sep 02 04:23:43.496167 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:43.684227 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-1776b4c3-b27f-409a-b7a0-60f8a7231752 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:43.690336 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.wsgi [None req-1776b4c3-b27f-409a-b7a0-60f8a7231752 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 04:23:43.690903 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-1776b4c3-b27f-409a-b7a0-60f8a7231752 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:43.691698 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-1776b4c3-b27f-409a-b7a0-60f8a7231752 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058259 Sep 02 04:23:43.692242 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1191 bytes} [Thu Sep 2 04:23:43 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 04:23:43.701821 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-838fc8db-47de-4e53-91ae-27793a0974a7 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:43.723561 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-838fc8db-47de-4e53-91ae-27793a0974a7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025274 Sep 02 04:23:43.724119 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:23:43.733802 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-67530eee-c7b7-4e5c-8fd7-a6a2ecf236f1 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:43.755743 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-67530eee-c7b7-4e5c-8fd7-a6a2ecf236f1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025374 Sep 02 04:23:43.756300 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:23:43.765798 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-1ce6a120-934b-40bc-bb05-d461e698ff16 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:43.771005 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.wsgi [None req-1ce6a120-934b-40bc-bb05-d461e698ff16 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 04:23:43.771574 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-1ce6a120-934b-40bc-bb05-d461e698ff16 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:43.772406 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-1ce6a120-934b-40bc-bb05-d461e698ff16 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010136 Sep 02 04:23:43.772896 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1191 bytes} [Thu Sep 2 04:23:43 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 04:23:45.117175 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-67530eee-c7b7-4e5c-8fd7-a6a2ecf236f1 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:45.120054 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-67530eee-c7b7-4e5c-8fd7-a6a2ecf236f1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 02 04:23:45.120054 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:45.307754 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-403d570b-2477-48fa-9580-45802b590313 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:45.313429 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.wsgi [None req-403d570b-2477-48fa-9580-45802b590313 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 04:23:45.313996 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-403d570b-2477-48fa-9580-45802b590313 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:45.314879 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-403d570b-2477-48fa-9580-45802b590313 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.058360 Sep 02 04:23:45.315383 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1191 bytes} [Thu Sep 2 04:23:45 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 04:23:45.325067 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-49342524-da95-405b-ad64-0723980cd6bc admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:45.338851 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-49342524-da95-405b-ad64-0723980cd6bc admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017394 Sep 02 04:23:45.339408 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:23:45.349548 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-d76caebc-242b-4741-bb46-678913224283 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:45.362998 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-d76caebc-242b-4741-bb46-678913224283 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016922 Sep 02 04:23:45.363506 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:23:45.372741 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-7e367534-1907-4c7e-a2ec-62b9a3f62012 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:45.377684 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.wsgi [None req-7e367534-1907-4c7e-a2ec-62b9a3f62012 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 04:23:45.378248 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-7e367534-1907-4c7e-a2ec-62b9a3f62012 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:45.379018 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-7e367534-1907-4c7e-a2ec-62b9a3f62012 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.009678 Sep 02 04:23:45.379491 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1191 bytes} [Thu Sep 2 04:23:45 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 02 04:23:46.708215 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-d76caebc-242b-4741-bb46-678913224283 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:46.709202 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-d76caebc-242b-4741-bb46-678913224283 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 02 04:23:46.709594 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:46.897212 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-43766a01-d787-4902-968b-3bed644ee520 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:46.902787 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.wsgi [None req-43766a01-d787-4902-968b-3bed644ee520 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 04:23:46.903342 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-43766a01-d787-4902-968b-3bed644ee520 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:46.904163 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-43766a01-d787-4902-968b-3bed644ee520 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057645 Sep 02 04:23:46.904646 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:23:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 04:23:46.914205 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-6bd71b94-4811-48ef-b1b2-c24bb8cba9fe admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:46.927888 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-6bd71b94-4811-48ef-b1b2-c24bb8cba9fe admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017180 Sep 02 04:23:46.928372 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:23:46.938822 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:46.952043 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017303 Sep 02 04:23:46.952562 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1211 bytes} [Thu Sep 2 04:23:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:23:46.962244 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-cb337f73-209f-4d25-835d-fdfccee10387 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:46.967410 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.wsgi [None req-cb337f73-209f-4d25-835d-fdfccee10387 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 04:23:46.968003 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-cb337f73-209f-4d25-835d-fdfccee10387 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:23:46.968784 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-cb337f73-209f-4d25-835d-fdfccee10387 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010142 Sep 02 04:23:46.969307 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:23:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 02 04:23:48.325885 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:48.326886 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 02 04:23:48.327302 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:48.518968 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-8e9cb5cd-47a9-4e4f-9db2-c147b5402e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:48.626779 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-8e9cb5cd-47a9-4e4f-9db2-c147b5402e2b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.158808 Sep 02 04:23:48.627245 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1236 bytes} [Thu Sep 2 04:23:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:23:49.977114 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:49.978106 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 02 04:23:49.978496 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:50.168363 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-6ad282b1-2eae-4991-ab6c-948b8bcbd510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:50.231172 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-6ad282b1-2eae-4991-ab6c-948b8bcbd510 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.113606 Sep 02 04:23:50.231644 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1236 bytes} [Thu Sep 2 04:23:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:23:51.577353 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:51.578954 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Sep 02 04:23:51.579341 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:51.766739 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-6c8bd1f8-1958-4c47-a8d8-f7a0d0626471 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:51.837327 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-6c8bd1f8-1958-4c47-a8d8-f7a0d0626471 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.121277 Sep 02 04:23:51.837791 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1236 bytes} [Thu Sep 2 04:23:51 2021] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:23:53.175840 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:53.176867 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 02 04:23:53.177257 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:53.367607 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-53cd858e-05ff-4597-b20c-f2f8549996f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:23:53.464337 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-53cd858e-05ff-4597-b20c-f2f8549996f7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.147239 Sep 02 04:23:53.464986 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1236 bytes} [Thu Sep 2 04:23:53 2021] POST /compute/v2.1/flavors => generated 409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:23:54.800125 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:54.801124 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 02 04:23:54.801513 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:23:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:23:54.990313 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-bb81a980-2ed1-4946-934e-bf1057c5d97b admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:23:55.009674 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-bb81a980-2ed1-4946-934e-bf1057c5d97b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.069261 Sep 02 04:23:55.010148 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1203 bytes} [Thu Sep 2 04:23:54 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:24:39.769803 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.770827 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-2fe43050-c759-45a6-9f22-d0397e6d4e98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Sep 02 04:24:39.771218 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:24:39.828687 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-a6d81c81-d862-47e0-8236-88b528c45945 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.847795 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-a6d81c81-d862-47e0-8236-88b528c45945 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070257 Sep 02 04:24:39.848349 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:24:39.870713 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-0c14c33f-aea5-4828-9abc-9b6d7e65c724 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.878234 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-0c14c33f-aea5-4828-9abc-9b6d7e65c724 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011032 Sep 02 04:24:39.878736 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:24:39.890016 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-d2fc6410-1f64-4eb7-ab0f-41a2183c4201 admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.897445 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-d2fc6410-1f64-4eb7-ab0f-41a2183c4201 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010850 Sep 02 04:24:39.897952 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:24:39.909380 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-23ace5c0-4141-4b03-927b-d650d13ef60b admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.916511 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-23ace5c0-4141-4b03-927b-d650d13ef60b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010397 Sep 02 04:24:39.917006 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:24:39.928679 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:24:39.935798 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010429 Sep 02 04:24:39.936349 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Thu Sep 2 04:24:39 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:26:20.658737 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-8f4a0433-6897-48ae-9396-e8a9635e9fe1 tempest-verify_tempest_config-1090653826 tempest-verify_tempest_config-1090653826-project] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:26:20.660840 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-8f4a0433-6897-48ae-9396-e8a9635e9fe1 tempest-verify_tempest_config-1090653826 tempest-verify_tempest_config-1090653826-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104899 Sep 02 04:26:20.661370 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1134 bytes} [Thu Sep 2 04:26:20 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:27:47.921845 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:27:47.922869 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 02 04:27:47.923245 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:27:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:27:48.196354 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:27:48.197502 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:27:48.197502 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:27:48.199035 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:27:48.199470 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:27:48.200273 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:27:48.200722 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:27:48.233582 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-f941d2b2-6f5c-4c4e-9b51-f21aa2144d8e admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.147026 Sep 02 04:27:48.234120 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 35/71] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:27:48 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:27:49.587892 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:27:49.588909 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 02 04:27:49.589305 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:27:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:27:49.781695 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:27:49.782855 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:27:49.782855 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:27:49.784413 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:27:49.784856 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:27:49.785640 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:27:49.786067 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:27:49.805153 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-a3472f30-f84a-4579-bea4-eeee422aa0ed admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.074849 Sep 02 04:27:49.805626 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 36/73] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:27:49 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:28:01.590420 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:28:01.591452 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 02 04:28:01.591845 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:28:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:28:01.784661 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:28:01.785846 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:28:01.785846 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:28:01.787330 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:28:01.787768 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:28:01.788685 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:28:01.789107 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:28:01.813475 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-4bfad199-434a-4e87-8331-412fa30cb089 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.080277 Sep 02 04:28:01.813952 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 37/75] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:28:01 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:28:03.155704 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: DEBUG nova.api.openstack.wsgi [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] Calling method '>' {{(pid=93709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:28:03.157232 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: INFO nova.api.openstack.requestlog [None req-46583289-d5c9-4eee-baae-15782fa2f51f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Sep 02 04:28:03.157627 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: [pid: 93709|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1075 bytes} [Thu Sep 2 04:28:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:28:03.348686 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG nova.api.openstack.wsgi [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] Calling method '>' {{(pid=93708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:28:03.349829 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:28:03.349829 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: warnings.warn(msg) Sep 02 04:28:03.351324 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:28:03.351760 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:28:03.352566 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:28:03.352985 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: DEBUG oslo_concurrency.lockutils [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:28:03.373674 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: INFO nova.api.openstack.requestlog [None req-c163fa1e-e363-43cd-beb3-8a1b138cac2b admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.074996 Sep 02 04:28:03.374149 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: [pid: 93708|app: 0|req: 38/77] 10.222.0.13 () {60 vars in 1194 bytes} [Thu Sep 2 04:28:03 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:28:59.652767 dv-cinder-804735-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 04:28:59.653649 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: Thu Sep 2 04:28:59 2021 - graceful shutdown triggered... Sep 02 04:28:59.654120 dv-cinder-804735-7-iscsi devstack@n-api.service[93708]: Gracefully killing worker 1 (pid: 93708)... Sep 02 04:28:59.654477 dv-cinder-804735-7-iscsi devstack@n-api.service[93709]: Gracefully killing worker 2 (pid: 93709)... Sep 02 04:29:00.654781 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: worker 1 buried after 1 seconds Sep 02 04:29:00.655224 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: worker 2 buried after 1 seconds Sep 02 04:29:00.655224 dv-cinder-804735-7-iscsi devstack@n-api.service[93707]: goodbye to uWSGI. Sep 02 04:29:00.656384 dv-cinder-804735-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 04:29:00.656915 dv-cinder-804735-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 04:29:00.659772 dv-cinder-804735-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 04:29:00.669543 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 2 04:29:00 2021] *** Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: nodename: dv-cinder-804735-7-iscsi Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: machine: x86_64 Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: clock source: unix Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: pcre jit disabled Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: detected number of CPU cores: 4 Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: current working directory: / Sep 02 04:29:00.671538 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: detected binary path: /usr/bin/uwsgi-core Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: your processes number limit is 47680 Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: your memory page size is 4096 bytes Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: detected max file descriptor number: 2048 Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: lock engine: pthread robust mutexes Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: thunder lock: enabled Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 04:29:00.672304 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 02 04:29:00.717993 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: Python main interpreter initialized at 0x5584e19c09c0 Sep 02 04:29:00.717993 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: python threads support enabled Sep 02 04:29:00.717993 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: your server socket listen backlog is limited to 100 connections Sep 02 04:29:00.717993 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: your mercy for graceful operations on workers is 90 seconds Sep 02 04:29:00.718456 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 04:29:00.718456 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: *** Operational MODE: preforking *** Sep 02 04:29:00.718726 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: *** uWSGI is running in multiple interpreter mode *** Sep 02 04:29:00.718726 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: spawned uWSGI master process (pid: 108873) Sep 02 04:29:00.718928 dv-cinder-804735-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 04:29:00.720266 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: spawned uWSGI worker 1 (pid: 108890, cores: 1) Sep 02 04:29:00.720266 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: spawned uWSGI worker 2 (pid: 108891, cores: 1) Sep 02 04:29:00.720266 dv-cinder-804735-7-iscsi devstack@n-api.service[108873]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 04:29:02.525041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:29:02.525041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: from cryptography.utils import int_from_bytes Sep 02 04:29:02.525769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:29:02.525769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: from cryptography.utils import int_from_bytes Sep 02 04:29:02.540794 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:29:02.540794 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: from cryptography.utils import int_from_bytes Sep 02 04:29:02.541379 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 04:29:02.541379 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: from cryptography.utils import int_from_bytes Sep 02 04:29:05.194737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 04:29:05.195286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 04:29:05.195390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 04:29:05.195738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 04:29:05.196019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 04:29:05.196409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.196734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.197054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.197372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.197702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.198012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.198336 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.198655 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.198982 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.199241 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.199556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.199884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-7-iscsi {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.200232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.200542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.200855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.201175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.201485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.201809 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.202117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.202619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.203357 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.203668 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.204106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.204462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.204775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.205087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.205413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.205723 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.206051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.206361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.207201 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-7-iscsi {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.207201 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.207534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.207832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.208282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.208603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.208893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.209218 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.209539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.209848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.210501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.210501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.210786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.211112 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.211415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.211729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.212184 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.212368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.212678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.212994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.213254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.213565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.213883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.214205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.214528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.214795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.215032 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.215360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.215673 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.216000 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.216310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.216619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.216921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.217227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.217528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.217832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.218139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.218456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.218770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.219090 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.219413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.219703 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.220134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.220390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.220697 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.221037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.221360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.221673 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.221991 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.222312 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.223157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.223289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 04:29:05.223720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.223801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 04:29:05.223887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.223993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 04:29:05.224430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.224538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 04:29:05.224625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.224733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 04:29:05.224820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.224895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.224968 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225552 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.225970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.226153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.226514 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.226650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.226784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.226870 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227618 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.227960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.228077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.228800 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.228916 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-7-iscsi {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229508 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.229822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.230902 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231246 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.231817 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232015 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232164 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232351 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.232970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.233113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.233574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.233719 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.233852 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.233992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234433 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-7-iscsi {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.234976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235247 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235519 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.235971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236669 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236802 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.236943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.237077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.237698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.237848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.237982 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.238187 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.238822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.238963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239115 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239115 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.239893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240618 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240703 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240787 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.240971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.241075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.241234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.241337 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.241538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.241792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.241886 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.242145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.242249 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.242463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.242557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.242712 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.242806 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.242959 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.243110 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.243273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.243416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.243587 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.243729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.243891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.244084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.244193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.244412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.244513 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.244727 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.244830 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.245038 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.245150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.245349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.245457 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.245667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.245764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.245965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.246070 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.246278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.246381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.246586 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.246681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.246906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.247045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.247205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.247341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.247516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.247612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.247843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.253874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.253874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.254221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.254550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.254755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.254923 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.255073 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.255230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.255389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.255539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.255844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.256075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.256183 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.256320 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.256475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.256566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.256651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.256884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.257027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.257118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.257280 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.257416 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.257534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.257676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.257774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.257863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.257957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.258052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.258299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.258484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.258662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.258848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.258943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259037 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.259130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259223 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.259317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.259509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259596 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.259680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.259849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.259951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.260058 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.260153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.260240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.260375 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.260467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.260562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.260656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.260782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.260881 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.260965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261058 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.261160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.261341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.261524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261609 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.261707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.261893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.261976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.262068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.262326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.262517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.262723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262817 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.262905 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.262997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.263090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.263185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.263280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.263367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.263458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.263543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.263630 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.263727 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.263822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.263965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.264152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.264341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.264519 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.264711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.264902 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.264989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.265082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.265177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.265277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.265372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.265372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.265542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.265682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.265773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.265920 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.266054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.266189 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.266321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.266455 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.266593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.266698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.266785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.266878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.266965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.267182 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.267382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267520 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 04:29:05.267611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267891 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.267891 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268679 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.268934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.269878 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270187 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270504 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.270835 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271024 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271340 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271508 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.271983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272699 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.272911 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273223 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.273959 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274478 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274800 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.274901 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.275830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.276816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.280951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281086 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.281984 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.282908 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283261 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.283932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.284053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.284148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.297649 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.298964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299151 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299335 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299518 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.299888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.300927 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.301980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302174 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302261 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302542 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302835 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.302934 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303108 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303293 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303832 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.303959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304594 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.304878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.305861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306012 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306284 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306422 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306709 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.306918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307197 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307486 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.307892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308309 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.308997 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309143 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309542 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.309930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310284 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310424 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.310968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.311993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312129 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312274 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.312913 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313284 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313669 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.313948 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314583 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.314917 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315669 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.315978 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.316075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.316697 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.316844 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317587 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317719 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.317963 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318609 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318711 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.318985 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319622 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319716 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.319889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320318 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.320947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321033 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321607 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.321984 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322452 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322641 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322831 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.322924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323554 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.323852 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.333889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334469 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334697 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.334983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335503 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335852 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.335955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336458 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.336918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337147 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.337977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338526 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.338987 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339690 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.339872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340119 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340477 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.340815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341508 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.341845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342396 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342877 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.342970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343064 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343246 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343660 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.343942 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.344891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345155 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345426 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345711 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345854 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.345993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.346957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.347099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.347295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.347964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348622 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.348885 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349162 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349440 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.349874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350156 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350523 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.350904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351306 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.351859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352567 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.352959 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353383 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.353967 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.354924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355065 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355548 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.355900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356053 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356583 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356668 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.356946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357465 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.357945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.358966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359201 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.359889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360794 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.360976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361163 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361520 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.361950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362351 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362806 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.362986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363129 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363392 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363577 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.363950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.364039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.368975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369310 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369802 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369901 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.369995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370174 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370548 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.370908 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371101 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371236 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371595 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371766 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.371979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372083 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372394 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372582 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.372950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373419 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373704 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373792 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.373969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374322 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374501 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.374960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375184 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375286 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375793 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.375878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376241 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376806 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376901 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.376988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377074 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377504 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.377963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378134 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.378588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379850 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.379997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380532 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380887 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.380971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381065 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381354 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381501 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.381983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382193 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382751 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382846 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.382941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383300 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383471 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383651 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383832 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.383942 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384033 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384119 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384488 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384573 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.384923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385386 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385656 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.385995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386318 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386502 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386589 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386683 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.386957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387534 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387621 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387716 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.387841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388731 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.388908 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389223 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389526 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.389849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.390902 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391437 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.391841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392084 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.392968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393670 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393869 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.393970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.394168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.394295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395076 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395729 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.395845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.402658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.402789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.402963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403058 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403296 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403391 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.403984 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404379 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404468 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404730 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.404919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405195 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405472 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.405998 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406185 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406607 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406695 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.406962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.407956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.408923 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409193 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409281 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409468 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.409980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410326 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410538 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.410919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411093 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411186 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411607 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411705 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.411889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412582 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.412930 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413066 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413621 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.413992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414182 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.414913 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.415938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416806 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.416918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.417888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.418834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419119 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419331 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419641 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.419963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420284 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420594 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.420897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.421950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422272 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.422894 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.423842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424651 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.424955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.425175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.425285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.425502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426337 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426644 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.426950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427059 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427573 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.427876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431191 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431452 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431802 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.431888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432125 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432374 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432468 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432728 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.432909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.433963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434147 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434466 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.434970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435247 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.435893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436791 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.436899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.437847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438129 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438347 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438450 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438656 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.438971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.439877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 04:29:05.440080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.440210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.440520 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.440827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.441134 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.441516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.441856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.442173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.442518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.442804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.443117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.443424 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.443730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.444057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.444367 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.444681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.445053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.445317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.445619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.446036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.446347 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.446662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.446982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.447289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.447608 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.447952 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.448257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.448577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.448888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.449218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.449553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.449878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.450200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.450500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.450803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.451105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.451409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.451737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.452071 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.452392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.452701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.453022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.453329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.453650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.453968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.454280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.454588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.454913 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.455221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.455531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.455837 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.456171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.459885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.460653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.460653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.460653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.460653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.461045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.461137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.461413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.461725 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.463953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.463953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.463953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.463953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_db.sqlalchemy.engines [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.464413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 04:29:05.464797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 04:29:05.487481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_db.sqlalchemy.engines [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.544199 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.context [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07406424-ea1b-4403-9f17-071fba3928c0(cell1) {{(pid=108890) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 04:29:05.548614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:05.550205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:05.551047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:05.553017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:05.565007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_db.sqlalchemy.engines [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.565816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_db.sqlalchemy.engines [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.566080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.context [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07406424-ea1b-4403-9f17-071fba3928c0(cell1) {{(pid=108891) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 04:29:05.570645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:05.572269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:05.573088 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:05.575041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:05.586439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_db.sqlalchemy.engines [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.588269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_db.sqlalchemy.engines [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.835268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_db.sqlalchemy.engines [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:05.851363 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_db.sqlalchemy.engines [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 04:29:06.159032 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: WARNING keystonemiddleware.auth_token [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:29:06.165826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: WARNING keystonemiddleware.auth_token [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:29:06.175105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: WARNING keystonemiddleware.auth_token [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:29:06.182212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: WARNING keystonemiddleware.auth_token [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:29:06.514722 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: WARNING keystonemiddleware.auth_token [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:29:06.520624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: WARNING keystonemiddleware.auth_token [None req-b4dc40bb-48d8-4cd2-94cd-26999c353ad9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:29:06.525202 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: WARNING keystonemiddleware.auth_token [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 04:29:06.525822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584e19c09c0 pid: 108890 (default app) Sep 02 04:29:06.530451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: WARNING keystonemiddleware.auth_token [None req-ff73a4ef-5db8-4e7b-9efa-e7bf94012ebe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 04:29:06.536230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584e19c09c0 pid: 108891 (default app) Sep 02 04:29:39.498646 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1798f33f-1ee4-4055-a12f-86f56f2b8988 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Action: 'create', calling method: .version_select at 0x7fa0512679d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-256034720", "metadata": {"Type": "work"}}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:39.498646 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1798f33f-1ee4-4055-a12f-86f56f2b8988 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:39.499512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1798f33f-1ee4-4055-a12f-86f56f2b8988 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.025899 Sep 02 04:29:39.504049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Sep 2 04:29:38 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1032 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:29:39.723251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-99917476-6784-4350-b958-35fca3ffa199 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Action: 'create', calling method: .version_select at 0x7fa0512b04c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1155189865", "metadata": {"Type": "work"}}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:39.726114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-99917476-6784-4350-b958-35fca3ffa199 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:39.727176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-99917476-6784-4350-b958-35fca3ffa199 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.219534 Sep 02 04:29:39.727897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Sep 2 04:29:39 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:29:39.738641 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b78b03ee-d9ba-437a-b2b8-b9e586ca1d72 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Action: 'create', calling method: .version_select at 0x7fa0512690d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-413545043", "metadata": {"Type": "work"}}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:39.740041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b78b03ee-d9ba-437a-b2b8-b9e586ca1d72 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:39.741305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b78b03ee-d9ba-437a-b2b8-b9e586ca1d72 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006597 Sep 02 04:29:39.742004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Sep 2 04:29:39 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:29:39.751167 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-425934b8-8f5e-4141-a466-b965491f947b tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Calling method '.version_select at 0x7fa0512b0b80>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:40.038150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2e97713a-c68a-4021-8ac1-e517d1ba750c tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Action: 'create', calling method: .version_select at 0x7fa0511a4550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-902645807"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:40.394560 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-425934b8-8f5e-4141-a466-b965491f947b tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] HTTP exception thrown: Volume tempest-invalid-1032723906 could not be found. Sep 02 04:29:40.395301 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-425934b8-8f5e-4141-a466-b965491f947b tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 404 to user: Volume tempest-invalid-1032723906 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:40.396232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-425934b8-8f5e-4141-a466-b965491f947b tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1032723906" status: 404 len: 99 microversion: 2.1 time: 0.648487 Sep 02 04:29:40.396767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1218 bytes} [Thu Sep 2 04:29:39 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1032723906 => generated 99 bytes in 650 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 02 04:29:40.406064 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5d4a09b3-b297-4653-8697-f4760903fde8 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003808 Sep 02 04:29:40.412672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 4/5] 10.222.0.13 () {58 vars in 1140 bytes} [Thu Sep 2 04:29:40 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 04:29:40.428534 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4efef57e-f2a9-4d22-9e68-588481651e11 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011708 Sep 02 04:29:40.433219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 5/6] 10.222.0.13 () {58 vars in 1137 bytes} [Thu Sep 2 04:29:40 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 04:29:40.440823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0ef63a08-d63a-49dd-81d4-e23a98c50fe4 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Calling method '.version_select at 0x7fa0511858b0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:40.497884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-0ef63a08-d63a-49dd-81d4-e23a98c50fe4 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] HTTP exception thrown: Volume 9cdc70e9-eb6d-4bd3-b0f4-313eb05de596 could not be found. Sep 02 04:29:40.498606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0ef63a08-d63a-49dd-81d4-e23a98c50fe4 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 404 to user: Volume 9cdc70e9-eb6d-4bd3-b0f4-313eb05de596 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:40.500052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0ef63a08-d63a-49dd-81d4-e23a98c50fe4 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/9cdc70e9-eb6d-4bd3-b0f4-313eb05de596" status: 404 len: 109 microversion: 2.1 time: 0.062820 Sep 02 04:29:40.500705 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 6/7] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:29:40 2021] DELETE /compute/v2.1/os-volumes/9cdc70e9-eb6d-4bd3-b0f4-313eb05de596 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:29:40.512279 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e59f66ac-3616-4f54-b437-b4c566fcd0b7 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Calling method '.version_select at 0x7fa051185ee0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:40.550662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-e59f66ac-3616-4f54-b437-b4c566fcd0b7 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] HTTP exception thrown: Volume 3bf5e84d-88b1-4fd2-b73b-f5e6d4fc2d4c could not be found. Sep 02 04:29:40.554170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e59f66ac-3616-4f54-b437-b4c566fcd0b7 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] Returning 404 to user: Volume 3bf5e84d-88b1-4fd2-b73b-f5e6d4fc2d4c could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:40.557145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e59f66ac-3616-4f54-b437-b4c566fcd0b7 tempest-VolumesNegativeTest-1697124523 tempest-VolumesNegativeTest-1697124523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3bf5e84d-88b1-4fd2-b73b-f5e6d4fc2d4c" status: 404 len: 109 microversion: 2.1 time: 0.049808 Sep 02 04:29:40.566254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 7/8] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:40 2021] GET /compute/v2.1/os-volumes/3bf5e84d-88b1-4fd2-b73b-f5e6d4fc2d4c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:29:41.369690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2e97713a-c68a-4021-8ac1-e517d1ba750c tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.749939 Sep 02 04:29:41.377152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 2/9] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Sep 2 04:29:39 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1752 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 04:29:41.383536 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7df0abd0-8e36-4cfb-9fca-6f79c4dce68b tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa051185c10>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:41.443855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7df0abd0-8e36-4cfb-9fca-6f79c4dce68b tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 200 len: 344 microversion: 2.1 time: 0.065034 Sep 02 04:29:41.455793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 8/10] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:41 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:29:42.457329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a214e183-7d02-4f55-8f82-cf086c400893 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa051138940>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:42.523461 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a214e183-7d02-4f55-8f82-cf086c400893 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 200 len: 344 microversion: 2.1 time: 0.070757 Sep 02 04:29:42.524051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 3/11] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:42 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:43.536505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e5509dbd-7be5-4d54-a61a-cbca81b92266 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa0511451f0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:43.738257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e5509dbd-7be5-4d54-a61a-cbca81b92266 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 200 len: 345 microversion: 2.1 time: 0.205935 Sep 02 04:29:43.739084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 4/12] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:43 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:29:43.750716 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a67fd2c2-f39c-4b42-8078-38f185bd5bcc tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Action: 'create', calling method: .version_select at 0x7fa051145b80>, body: {"snapshot": {"volume_id": "8903150d-0ce9-4b84-868a-42f6f361e94e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-993023750"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:43.872872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-801872505", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "1edf8d96-2ca8-4884-968d-e0e3a9a38f62"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:44.069545 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] validate_networks() for [('1edf8d96-2ca8-4884-968d-e0e3a9a38f62', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:29:44.353641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a67fd2c2-f39c-4b42-8078-38f185bd5bcc tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.606098 Sep 02 04:29:44.354181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 5/13] 10.222.0.13 () {60 vars in 1162 bytes} [Thu Sep 2 04:29:43 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:29:44.744904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1650641394", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "26ff5384-f842-4306-a318-71b587753ace"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:44.913137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] validate_networks() for [('26ff5384-f842-4306-a318-71b587753ace', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:29:45.770755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:29:45.772046 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:29:45.772742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:29:45.773317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:29:45.774456 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:29:45.827418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:45.828359 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:45.829930 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:45.831047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:45.884995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Getting quotas for project a5b6525c725444b7aa20bdb9a47c55f4. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:45.895062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Getting quotas for user 7bb043c7f84643fc9d5ad2cdbcf15dc7 and project a5b6525c725444b7aa20bdb9a47c55f4. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:45.912003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:29:45.917293 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:29:46.155096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e0318d58-b3fa-4b0e-8efa-08a4fa161159 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670131 Sep 02 04:29:46.156490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 9/14] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:29:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:29:46.173493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-02fe9477-3d10-4393-8f7e-a6a8a27d580f tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa050839b80>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:46.283191 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-02fe9477-3d10-4393-8f7e-a6a8a27d580f tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 200 len: 286 microversion: 2.1 time: 0.122394 Sep 02 04:29:46.283767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 10/15] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:46 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:46.292601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-541d7666-fbea-48f2-b814-63316c7a971b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:46.293732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-541d7666-fbea-48f2-b814-63316c7a971b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:46.447250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-541d7666-fbea-48f2-b814-63316c7a971b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:46.496193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-541d7666-fbea-48f2-b814-63316c7a971b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1214 microversion: 2.1 time: 0.209562 Sep 02 04:29:46.497371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 11/16] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:46 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:46.520890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4460b6ab-c69f-4f41-bf67-a95f8e3c3c89 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bfc4670>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:46.630655 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4460b6ab-c69f-4f41-bf67-a95f8e3c3c89 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.131365 Sep 02 04:29:46.631506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 12/17] 10.222.0.13 () {58 vars in 1140 bytes} [Thu Sep 2 04:29:46 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:46.642073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-50a2b8dc-e2db-4817-802b-07c8290b277a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa050857670>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:46.703500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-50a2b8dc-e2db-4817-802b-07c8290b277a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 200 len: 286 microversion: 2.1 time: 0.065533 Sep 02 04:29:46.708511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 13/18] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:46 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:29:47.309428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:29:47.309946 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:29:47.310373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:29:47.310724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:29:47.311140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:29:47.364985 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:47.367714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:47.370741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:47.372104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:47.426304 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:47.440709 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for user c05601393e5948458fd6e350520776c5 and project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:47.460597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:29:47.464452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:29:47.517253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-80e51491-f4f8-42cf-9dde-c09484c420b9 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:47.519840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-80e51491-f4f8-42cf-9dde-c09484c420b9 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:47.653218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-80e51491-f4f8-42cf-9dde-c09484c420b9 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:47.667023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-80e51491-f4f8-42cf-9dde-c09484c420b9 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1214 microversion: 2.1 time: 0.155330 Sep 02 04:29:47.673380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 14/19] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:47 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:47.721268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e12ccc1-e6bc-4d27-acbf-8a8ed172ec11 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.364323 Sep 02 04:29:47.722113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-30b80aa2-6238-430e-a9bd-022e92e0f4f3 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bfdbee0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:47.722623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 6/20] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:29:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 3368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:29:47.735666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c1a4cc03-0bb2-4633-8f97-9fe60b3d7dc4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:47.737188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c1a4cc03-0bb2-4633-8f97-9fe60b3d7dc4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:47.806402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-30b80aa2-6238-430e-a9bd-022e92e0f4f3 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 200 len: 286 microversion: 2.1 time: 0.093645 Sep 02 04:29:47.806977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 15/21] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:47 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:48.111045 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c1a4cc03-0bb2-4633-8f97-9fe60b3d7dc4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:48.145198 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c1a4cc03-0bb2-4633-8f97-9fe60b3d7dc4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1218 microversion: 2.1 time: 0.415732 Sep 02 04:29:48.145874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 7/22] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:47 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:29:48.686160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:48.687411 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:48.693624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:48.694278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:48.708813 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:48.709276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:48.818655 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-66ec4ab9-ea98-4ba4-877b-2f585b9075bf tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bfc9550>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:48.909973 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-66ec4ab9-ea98-4ba4-877b-2f585b9075bf tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 200 len: 287 microversion: 2.1 time: 0.095376 Sep 02 04:29:48.911294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 8/23] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:48 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:48.921393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ec1f2b1a-26d7-4d72-9242-1519016d8e8c tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bfde790>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:49.047057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:49.065648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9c6e6e1f-89a2-49b0-979b-c86d97e03cfd tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1210 microversion: 2.1 time: 0.382937 Sep 02 04:29:49.069735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 16/24] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:48 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1210 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:49.155154 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ec1f2b1a-26d7-4d72-9242-1519016d8e8c tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 202 len: 0 microversion: 2.1 time: 0.237723 Sep 02 04:29:49.155775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 9/25] 10.222.0.13 () {58 vars in 1254 bytes} [Thu Sep 2 04:29:48 2021] DELETE /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:29:49.167093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-938a592e-0984-45de-9eeb-058942e89a29 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:49.169358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-938a592e-0984-45de-9eeb-058942e89a29 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:49.173004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d7260daa-a5d1-438f-8324-94659c7e6373 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bfdee50>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:49.255527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d7260daa-a5d1-438f-8324-94659c7e6373 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 200 len: 286 microversion: 2.1 time: 0.092755 Sep 02 04:29:49.256096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 10/26] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:49 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:49.360551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-938a592e-0984-45de-9eeb-058942e89a29 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:49.368970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-938a592e-0984-45de-9eeb-058942e89a29 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1218 microversion: 2.1 time: 0.209819 Sep 02 04:29:49.373565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 17/27] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:49 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:50.088521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:50.089531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:50.096321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:50.097072 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:50.098206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:50.098938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:50.267099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8cc2c8ef-054f-4b6a-9ff5-94c73c9649f2 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bf50dc0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:50.333739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-8cc2c8ef-054f-4b6a-9ff5-94c73c9649f2 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] HTTP exception thrown: Snapshot 33e319cf-b488-455c-bfa4-9edd2efe0cd7 could not be found. Sep 02 04:29:50.334689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8cc2c8ef-054f-4b6a-9ff5-94c73c9649f2 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Returning 404 to user: Snapshot 33e319cf-b488-455c-bfa4-9edd2efe0cd7 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:50.335694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8cc2c8ef-054f-4b6a-9ff5-94c73c9649f2 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7" status: 404 len: 111 microversion: 2.1 time: 0.072569 Sep 02 04:29:50.337018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 18/28] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Sep 2 04:29:50 2021] GET /compute/v2.1/os-snapshots/33e319cf-b488-455c-bfa4-9edd2efe0cd7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:29:50.346897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-92aa834c-2612-4315-8367-8f3f3cab8f8d tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bf449d0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:50.507825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:50.522888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-10f1a650-a648-4a49-8cef-94dcb8fdaffb tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1266 microversion: 2.1 time: 0.439111 Sep 02 04:29:50.524098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 11/29] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:50 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:50.534840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:50.535498 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:50.553174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:50.554180 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:50.554970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:50.556368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:50.795806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-92aa834c-2612-4315-8367-8f3f3cab8f8d tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 202 len: 0 microversion: 2.1 time: 0.453597 Sep 02 04:29:50.797272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 19/30] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:29:50 2021] DELETE /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:29:50.909074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:50.920799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-942159a6-ef20-497b-8f09-99be0b9dab1c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1270 microversion: 2.1 time: 0.394454 Sep 02 04:29:50.924363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:50 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1270 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:50.931266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c3657960-9797-4a0d-a3e0-feeb6b0d122f tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bf08ee0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:51.060593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c3657960-9797-4a0d-a3e0-feeb6b0d122f tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 200 len: 344 microversion: 2.1 time: 0.133553 Sep 02 04:29:51.061179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 13/32] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:50 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:29:51.270013 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: .version_select at 0x7fa04bf44790>, body: {"keypair": {"name": "tempest-keypair-10575427"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:51.380093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:51.393812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:51.541634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:51.547130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:51.562545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:51.568711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:51.573586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:51.574201 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:52.130897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:52.140055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bf6c9203-0df7-4ce7-9975-32509f188628 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1272 microversion: 2.1 time: 0.603685 Sep 02 04:29:52.148648 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 14/33] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:51 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1272 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:29:52.153313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:52.153870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:52.471428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:52.471428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:52.471428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:52.471428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:52.475833 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:52.475833 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:52.479944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:52.479944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3a2c21fb-8f09-4ad2-826b-df5d9c4354d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1276 microversion: 2.1 time: 0.198757 Sep 02 04:29:52.479944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 15/34] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:52 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:52.479944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-783cfd5a-063e-4b7a-b617-2c9998e47d8e tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bf79ee0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:52.481898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b0f52131-3ce4-451a-adb5-80ab08784913 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 1.571277 Sep 02 04:29:52.481898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 20/35] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Sep 2 04:29:50 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1573 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 02 04:29:52.482341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-783cfd5a-063e-4b7a-b617-2c9998e47d8e tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] HTTP exception thrown: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. Sep 02 04:29:52.482341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-783cfd5a-063e-4b7a-b617-2c9998e47d8e tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Returning 404 to user: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:52.482341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-783cfd5a-063e-4b7a-b617-2c9998e47d8e tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 404 len: 109 microversion: 2.1 time: 0.096437 Sep 02 04:29:52.482341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 16/36] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:52 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:29:52.482810 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d3e09988-1c31-4004-b043-3134386f7080 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa04bf508b0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:52.562552 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-d3e09988-1c31-4004-b043-3134386f7080 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] HTTP exception thrown: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. Sep 02 04:29:52.563497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d3e09988-1c31-4004-b043-3134386f7080 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Returning 404 to user: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:52.564564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d3e09988-1c31-4004-b043-3134386f7080 tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 404 len: 109 microversion: 2.1 time: 0.100745 Sep 02 04:29:52.574873 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c19ef208-7a7f-444e-953a-038c3c00ac0a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Calling method '.version_select at 0x7fa0511a40d0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:52.575753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 21/37] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:29:52 2021] DELETE /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:29:52.640110 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-c19ef208-7a7f-444e-953a-038c3c00ac0a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] HTTP exception thrown: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. Sep 02 04:29:52.641596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c19ef208-7a7f-444e-953a-038c3c00ac0a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] Returning 404 to user: Volume 8903150d-0ce9-4b84-868a-42f6f361e94e could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:29:52.642966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c19ef208-7a7f-444e-953a-038c3c00ac0a tempest-VolumesSnapshotsTestJSON-923917795 tempest-VolumesSnapshotsTestJSON-923917795-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e" status: 404 len: 109 microversion: 2.1 time: 0.072738 Sep 02 04:29:52.643520 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 17/38] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:29:52 2021] GET /compute/v2.1/os-volumes/8903150d-0ce9-4b84-868a-42f6f361e94e => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:29:53.166243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:53.167156 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:53.182931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:53.193145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:53.194209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:53.198601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:53.375603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:53.375603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:53.382645 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:53.383094 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:53.383869 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:53.404327 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:53.682789 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:53.695068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-75bdfc40-d689-466f-8225-31ab710c2f66 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1272 microversion: 2.1 time: 0.532651 Sep 02 04:29:53.704474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 22/39] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:53 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1272 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:53.954000 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:53.991664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-47d7c4c7-a93a-49f2-b3dd-a65a30b742d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1276 microversion: 2.1 time: 0.611030 Sep 02 04:29:53.996965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 18/40] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:53 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1276 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:54.722898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:54.724371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:54.748116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:54.748931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:54.749816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:54.750346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:55.010834 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:55.017711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:55.044777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:55.046608 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:55.049278 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:55.070763 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:55.111303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:55.120955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9e7f49f8-af98-471d-8349-be8efdb4ab4b tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1272 microversion: 2.1 time: 0.402560 Sep 02 04:29:55.134905 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 23/41] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:54 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1272 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:55.200770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:55.224014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9684323e-8b5e-4421-87a5-bec1d5d04a96 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1276 microversion: 2.1 time: 0.217032 Sep 02 04:29:55.243808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 19/42] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:55 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:29:56.141237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:56.143752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:56.155269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:56.170089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:56.172924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:56.174951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:56.222241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: .version_select at 0x7fa04bf36550>, body: {"keypair": {"name": "tempest-keypair-1105346202"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:56.311563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:56.332473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:56.795207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:56.804542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f317713a-1332-4fd5-ae8a-4ef4e3b78765 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.667036 Sep 02 04:29:56.805712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:56 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:56.810866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:56.811686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:56.847998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:56.851584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:56.852653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:56.856570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:56.965564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:29:57.000101 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:29:57.050839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-daa77231-0f11-42c9-bb1d-3262945451c8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.606268 Sep 02 04:29:57.057554 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 24/44] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Sep 2 04:29:55 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:57.671071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:57.685422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5097ab1e-5352-4e2d-b3b6-5709986c1b48 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.878432 Sep 02 04:29:57.698017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 21/45] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:56 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:57.821772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:57.822998 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:57.830457 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:57.831140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:57.837961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:57.838624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:58.706309 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:29:58.706932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:29:58.720579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:58.722423 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:58.725976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:29:58.728268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:29:59.339794 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:59.381783 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4ac18405-03c9-4c54-99ce-6d1d6887751d tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 1.560197 Sep 02 04:29:59.383102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 25/46] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:57 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:29:59.403044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:29:59.752255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-27cc1416-d442-4286-8965-2d7f5fc5adb4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.735395 Sep 02 04:29:59.752255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:29:58 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:29:59.754056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1868579899", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "263dad98-82eb-49f5-a7aa-96a45a3136eb"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:29:59.833932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] validate_networks() for [('263dad98-82eb-49f5-a7aa-96a45a3136eb', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:00.399558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:00.400585 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:00.411380 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:00.412364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:00.414616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:00.416160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:01.245753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:01.256409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-123e51dd-17fb-492d-afad-663cb1236a4a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.861512 Sep 02 04:30:01.258931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:00 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:01.274084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:01.275082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:01.281510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:01.282354 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:01.283542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:01.284266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:01.384950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:01.385654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:01.386244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:01.386754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:01.387735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:01.430116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:01.437326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:01.438606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:01.444474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:01.518263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Getting quotas for project 56f3fc4797ec410b8f3fb46fc7409fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:01.536249 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Getting quotas for user a96ae12c709e468490680328fc553b96 and project 56f3fc4797ec410b8f3fb46fc7409fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:01.554220 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:01.556456 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:01.782972 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a8147659-4708-4427-8b5f-9d51d67d8206 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.398520 Sep 02 04:30:01.783862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 26/49] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:29:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:30:01.809571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3f8f1d94-b680-4b2f-a041-5ee58f0fa8fa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:01.810435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3f8f1d94-b680-4b2f-a041-5ee58f0fa8fa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:02.348341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:02.351407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3f8f1d94-b680-4b2f-a041-5ee58f0fa8fa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:02.359242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3f8f1d94-b680-4b2f-a041-5ee58f0fa8fa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1222 microversion: 2.1 time: 0.554000 Sep 02 04:30:02.364373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 27/50] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:01 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1222 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:02.364831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-82a21244-e9a9-4083-9084-b8041d1d8e9d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 1.094296 Sep 02 04:30:02.365612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 24/51] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:01 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:02.369359 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:02.372181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:02.405743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:02.406366 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:02.407157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:02.407638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:02.643672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:02.660790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-67f2a29f-3bb8-4a00-823f-1b6fb3b84102 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.287964 Sep 02 04:30:02.660790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 28/52] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:02 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:02.670962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1764823321", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "263dad98-82eb-49f5-a7aa-96a45a3136eb"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:03.019681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] validate_networks() for [('263dad98-82eb-49f5-a7aa-96a45a3136eb', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:03.021289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-ca1c4a08-4d81-499e-b4d2-18322fd2c66d req-0fd5a099-76fd-4ce4-8c00-e0d83a425dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7102e2-bb80-4a08-8689-fe3c5678fb83", "tag": "7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:03.021289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:03.021289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:03.021289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ca1c4a08-4d81-499e-b4d2-18322fd2c66d req-0fd5a099-76fd-4ce4-8c00-e0d83a425dbb service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.021289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ca1c4a08-4d81-499e-b4d2-18322fd2c66d req-0fd5a099-76fd-4ce4-8c00-e0d83a425dbb service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.022546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-ca1c4a08-4d81-499e-b4d2-18322fd2c66d req-0fd5a099-76fd-4ce4-8c00-e0d83a425dbb service nova] Creating event network-changed:7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb for instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 on hv-cinder-80473 Sep 02 04:30:03.022546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ca1c4a08-4d81-499e-b4d2-18322fd2c66d req-0fd5a099-76fd-4ce4-8c00-e0d83a425dbb service nova] Acquired lock "compute-rpcapi-router" {{(pid=108890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 02 04:30:03.022546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.022546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.022546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.022998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.022998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.compute.rpcapi [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 59 Sep 02 04:30:03.022998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=108890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 02 04:30:03.066025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-562ae1b2-d365-44ac-ad2d-c768312f23a2 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600451 Sep 02 04:30:03.073123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 25/53] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:03.502289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:03.502289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:03.502289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.502289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.503628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.503628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.911080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:03.911080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8898d48c-96ce-4f74-9243-f428de79c50d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.470912 Sep 02 04:30:03.911080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:03 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:03.911080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:03.912533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:03.912533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.912533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.912533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.913144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.913362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:03.913362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:03.913362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:03.913362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:03.913362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:03.914050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.914050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.914050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:03.914050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:03.952555 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Getting quotas for project 56f3fc4797ec410b8f3fb46fc7409fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:03.966307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Getting quotas for user a96ae12c709e468490680328fc553b96 and project 56f3fc4797ec410b8f3fb46fc7409fe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:03.990596 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:03.994572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:04.180464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:04.198216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8b437986-54e1-467b-8bf2-28bd3566f979 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.347014 Sep 02 04:30:04.198994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 27/55] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:03 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:04.232130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-167938334", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46143dd2-0d1f-423e-b171-0ee837e54bfa"}], "security_groups": [{"name": "tempest-securitygroup--1545539191"}], "key_name": "tempest-keypair-10575427", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:04.245764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eed0edbf-eae5-4d83-a24f-9fee02333545 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.588701 Sep 02 04:30:04.246672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 29/56] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:30:02 2021] POST /compute/v2.1/servers => generated 383 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:30:04.273920 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-603c3bc0-df39-4f87-97f4-6b9844e2ad70 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:04.273920 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-603c3bc0-df39-4f87-97f4-6b9844e2ad70 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:04.651931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-603c3bc0-df39-4f87-97f4-6b9844e2ad70 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:04.666504 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-603c3bc0-df39-4f87-97f4-6b9844e2ad70 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1222 microversion: 2.1 time: 0.411356 Sep 02 04:30:04.672230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 30/57] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:04 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1222 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:04.699985 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] validate_networks() for [('46143dd2-0d1f-423e-b171-0ee837e54bfa', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:04.945122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:04.946454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:04.958402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:04.959054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:04.960071 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:04.960650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.568853 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:05.569101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:05.569864 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:05.570780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:05.571369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:05.593467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.594134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.595924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.596461 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.635018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:05.647193 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:05.679095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:05.680303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:05.695052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-47b70184-f4f9-40ed-870b-ed918b3d8b88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.750301 Sep 02 04:30:05.695052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 31/58] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:04 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:05.695225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:05.706920 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-840acc41-82b3-474e-bd02-1ff503338bf8 req-df10c5d2-5b1e-4ef9-bdb2-9cb485ca0f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e91f6e8-1260-4e45-afc2-e02c3250f91b", "tag": "3c711505-4162-4e0a-af45-c6ecdc0466d0"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:05.709377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:05.709377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:05.722757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-840acc41-82b3-474e-bd02-1ff503338bf8 req-df10c5d2-5b1e-4ef9-bdb2-9cb485ca0f6a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.724079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-840acc41-82b3-474e-bd02-1ff503338bf8 req-df10c5d2-5b1e-4ef9-bdb2-9cb485ca0f6a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.747601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-840acc41-82b3-474e-bd02-1ff503338bf8 req-df10c5d2-5b1e-4ef9-bdb2-9cb485ca0f6a service nova] Creating event network-changed:3c711505-4162-4e0a-af45-c6ecdc0466d0 for instance 7e91f6e8-1260-4e45-afc2-e02c3250f91b on hv-cinder-80473 Sep 02 04:30:05.748376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-840acc41-82b3-474e-bd02-1ff503338bf8 req-df10c5d2-5b1e-4ef9-bdb2-9cb485ca0f6a service nova] Acquired lock "compute-rpcapi-router" {{(pid=108891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 02 04:30:05.749775 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.750531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.751817 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.752786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.765772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.compute.rpcapi [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 59 Sep 02 04:30:05.767576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=108891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 02 04:30:05.810655 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-36951e4d-7c8b-4598-9ca9-bf5f759652f1 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115624 Sep 02 04:30:05.814749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 32/59] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:05.819466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:05.820491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:05.836226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.837677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:05.840782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:05.841792 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:06.017744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-678ba2a6-b24e-4b43-838c-9952d526195c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.807225 Sep 02 04:30:06.018527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 28/60] 10.222.0.13 () {62 vars in 1188 bytes} [Thu Sep 2 04:30:04 2021] POST /compute/v2.1/servers => generated 402 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 04:30:06.057417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-869a15ad-2910-4336-9d6b-c14f9716e385 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf3d670>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:06.168806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:06.174212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-869a15ad-2910-4336-9d6b-c14f9716e385 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/19f9f200-beb0-44ef-95cc-0fc1ea0c0f56" status: 200 len: 350 microversion: 2.1 time: 0.151217 Sep 02 04:30:06.174786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 29/61] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:30:06 2021] GET /compute/v2.1/os-volumes/19f9f200-beb0-44ef-95cc-0fc1ea0c0f56 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:06.186441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:06.204157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:06.212522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-acdcd704-b275-41a5-82e3-f466b96f8334 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.395293 Sep 02 04:30:06.215236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 33/62] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:05 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:06.267335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:06.269343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:06.269973 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:06.270799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:06.273055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:06.275147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:06.380727 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:06.389093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:06.390738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:06.392567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dd740aa3-3abe-4855-aacf-1f4da41f1690 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1279 microversion: 2.20 time: 0.173227 Sep 02 04:30:06.415595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 34/63] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:06 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:06.420673 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-968784110", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad90c133-531e-4d6b-a1ec-5f41d66215bb"}], "security_groups": [{"name": "tempest-securitygroup--742827309"}], "key_name": "tempest-keypair-1105346202", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:06.536391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:06.544851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6d2a0b2f-63a8-4c87-98d3-1892acf34855 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1226 microversion: 2.1 time: 0.367762 Sep 02 04:30:06.559753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 30/64] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:06 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1226 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:06.681425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] validate_networks() for [('ad90c133-531e-4d6b-a1ec-5f41d66215bb', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:06.710186 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:06.711182 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:06.721970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:06.722686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:06.723620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:06.725580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.011712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.022596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-237c862e-61f6-4297-bcd8-c854aefaaedf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.315595 Sep 02 04:30:07.024306 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 31/65] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:06 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:07.234168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:07.236825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:07.253576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.255361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.256934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.271022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.611704 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.620144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-100f9575-d6be-40e1-a20e-a1759b9d7079 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.391802 Sep 02 04:30:07.629993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 32/66] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:07 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:07.633530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:07.634600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:07.748739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.760894 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.763863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.766080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0d4fd37a-a172-49ab-9383-a0b1d1c98201 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1279 microversion: 2.20 time: 0.144011 Sep 02 04:30:07.777639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:07 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:07.781235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:07.781864 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:07.788169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.788621 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.789390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.789993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.944002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:07.954017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2b5ebcdc-dc5f-4d70-9c47-e60111db4c29 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1218 microversion: 2.1 time: 0.183985 Sep 02 04:30:07.958068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:07 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:07.979774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:07.979774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:07.979774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:07.979774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:07.980559 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:07.989823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.990158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:07.990951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:07.991377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.008564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:08.012503 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:08.023745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:08.026333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:08.040943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.042166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:08.049206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.050006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.050930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.051513 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.227846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ff8d016d-343e-401e-aa15-27916e2b5a19 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.810793 Sep 02 04:30:08.236694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 35/69] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:30:06 2021] POST /compute/v2.1/servers => generated 401 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:30:08.246144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ba4fbe3c-d0cf-4493-901d-5c2dc62cb60e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.246779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ba4fbe3c-d0cf-4493-901d-5c2dc62cb60e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:08.353557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:08.368975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3d7cb7ae-43f9-46e8-ba6a-b6c021efb206 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.331947 Sep 02 04:30:08.369958 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 35/70] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:08.370445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ba4fbe3c-d0cf-4493-901d-5c2dc62cb60e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:08.400694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ba4fbe3c-d0cf-4493-901d-5c2dc62cb60e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1237 microversion: 2.1 time: 0.143166 Sep 02 04:30:08.400694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 36/71] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:08.593494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-593ee196-2e84-4b71-93b4-676af46ffdc4 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bea3700>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.639323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.640395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:08.650483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.651094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.652568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.660192 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-593ee196-2e84-4b71-93b4-676af46ffdc4 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4e799c3a-52e4-4671-83cc-1bd64da9b2dc" status: 200 len: 350 microversion: 2.1 time: 0.069825 Sep 02 04:30:08.668506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/os-volumes/4e799c3a-52e4-4671-83cc-1bd64da9b2dc => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:08.668728 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.787726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.793319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:08.796951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.797762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.802630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:08.804445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:08.894548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:08.912252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:08.916984 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:08.928285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3f942287-6c1a-44d1-a5a2-731115451e98 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1331 microversion: 2.20 time: 0.135286 Sep 02 04:30:08.928285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 37/73] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:08.981599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:08.983511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:09.002088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.006561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.008162 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.018627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.096584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:09.112982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-53cdce38-217c-4041-9a75-62db51caffa6 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.479222 Sep 02 04:30:09.113662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 37/74] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:09.153485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:09.163978 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7454e17f-bc42-4289-a8a2-403350ba2468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1282 microversion: 2.1 time: 0.196209 Sep 02 04:30:09.165240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 38/75] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:08 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:09.386238 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:09.387022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:09.395444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.401136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:09.402256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:09.405146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.417099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.418781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.419395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.424352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.425146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.425601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.664952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:09.690022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-22463ca6-9c1a-426f-8932-5535e8dd45de tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1241 microversion: 2.1 time: 0.292380 Sep 02 04:30:09.692854 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:09 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1241 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:09.944499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:09.945893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:09.949300 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:09.958718 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.959473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4c0d3594-c916-4b24-8ce6-3a4950126649 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.576851 Sep 02 04:30:09.960090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:09 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:09.961484 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:09.963725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:09.966330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.130553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.137280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:10.151172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.151879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.154441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.155090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.225617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.234043 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.236118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.237242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2e8dac7c-6524-4db9-8e73-4e06ea8c9612 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1339 microversion: 2.20 time: 0.299014 Sep 02 04:30:10.237801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 40/78] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:09 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:10.252149 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.253575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:10.259892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.260562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.261483 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.262061 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.341751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.348398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1f289b7e-7225-4811-89e1-a8882d7bf178 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1280 microversion: 2.1 time: 0.103770 Sep 02 04:30:10.348976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 41/79] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:10.390396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.398787 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b753cde9-1d09-4067-8f08-cf030678cf31 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.272037 Sep 02 04:30:10.399510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:10.719495 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.720981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1363deae-9a51-4c17-90a5-1982ed86807d tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf44f70>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.721098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:10.733036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.735130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.737339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.737804 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.793362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1363deae-9a51-4c17-90a5-1982ed86807d tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c66aac2d-6d47-492e-85fb-5fa0b95cf0a4" status: 200 len: 351 microversion: 2.1 time: 0.088098 Sep 02 04:30:10.793930 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 40/81] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/os-volumes/c66aac2d-6d47-492e-85fb-5fa0b95cf0a4 => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:10.806249 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0426e42c-646c-4da0-abe9-724d2aed716e tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04b643f70>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.870269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:10.877590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-565f75b7-d0ac-4c0a-a0ff-44d75125888f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1289 microversion: 2.1 time: 0.169823 Sep 02 04:30:10.878431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1289 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:10.909406 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0426e42c-646c-4da0-abe9-724d2aed716e tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.107523 Sep 02 04:30:10.910553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1134 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:10.922243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-98bdc75e-4250-4552-b64a-2447ca481d64 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf4ba60>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.977927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:10.979359 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:10.992602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.993265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:10.994743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:10.996015 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.008265 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-98bdc75e-4250-4552-b64a-2447ca481d64 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089485 Sep 02 04:30:11.016402 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1149 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:11.024316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e400e73b-4971-4d0d-8bc5-48a4db82b9bf tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bea3310>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.116187 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e400e73b-4971-4d0d-8bc5-48a4db82b9bf tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097259 Sep 02 04:30:11.117855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1134 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:11.129816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b3afd652-d5a1-4401-9764-91e4558f7aba tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf3dee0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.217780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b3afd652-d5a1-4401-9764-91e4558f7aba tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092504 Sep 02 04:30:11.218339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1167 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:11.231447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-305e4519-5947-42f4-ac98-ca52fe801810 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf3daf0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.492381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-305e4519-5947-42f4-ac98-ca52fe801810 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.254473 Sep 02 04:30:11.492381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 46/87] 10.222.0.13 () {58 vars in 1170 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:11.499890 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.500855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:11.513315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.513315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.513315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.513315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.696709 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:11.719790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:11.723298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:11.729226 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8d24115e-b3f8-4504-90fd-9b11c11ff5b9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1337 microversion: 2.20 time: 0.245481 Sep 02 04:30:11.732984 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:11.733743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 47/88] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:11.742817 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8da4eb9e-6054-4697-b4e8-086ceb21da9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.770427 Sep 02 04:30:11.743406 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 42/89] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:10 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:11.760814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.761811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:11.765869 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:11.771593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:11.778011 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.778467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.779288 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.779735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.789713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.790452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:11.794453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:11.794453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.139062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:12.160380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:12.163849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-acac1aeb-1c48-454c-be0c-307d3781809f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.427484 Sep 02 04:30:12.167444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 48/90] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:12.178858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a6914f6d-f12c-4547-a124-3ee14e3fcfb8 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf08550>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.197062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-470b6b2d-e9f9-475a-bebc-74782865fbc8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.430685 Sep 02 04:30:12.199823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 43/91] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:11 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:12.317319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a6914f6d-f12c-4547-a124-3ee14e3fcfb8 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.146997 Sep 02 04:30:12.325191 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 49/92] 10.222.0.13 () {58 vars in 1155 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:12.330021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.330636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:12.337277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.337720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.338479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.338903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.367073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-6e45526d-1379-4b66-af5e-91de5cbc23d2 req-6051df20-1e9a-46a7-b651-9a5a810c6d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffde743-fe81-4cab-9344-57ca521c59f4", "tag": "3146d225-6bdc-4864-a93a-c0e1301bc12c"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:12.369394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:12.369394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:12.384384 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6e45526d-1379-4b66-af5e-91de5cbc23d2 req-6051df20-1e9a-46a7-b651-9a5a810c6d93 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.385128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6e45526d-1379-4b66-af5e-91de5cbc23d2 req-6051df20-1e9a-46a7-b651-9a5a810c6d93 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.399133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-6e45526d-1379-4b66-af5e-91de5cbc23d2 req-6051df20-1e9a-46a7-b651-9a5a810c6d93 service nova] Creating event network-changed:3146d225-6bdc-4864-a93a-c0e1301bc12c for instance 3ffde743-fe81-4cab-9344-57ca521c59f4 on hv-cinder-80473 Sep 02 04:30:12.409624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-6e45526d-1379-4b66-af5e-91de5cbc23d2 req-6051df20-1e9a-46a7-b651-9a5a810c6d93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195374 Sep 02 04:30:12.412688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 44/93] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:12.430016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c13c077d-910d-4d86-93e1-85d8e9c762e5 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf44e50>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.455965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:12.485101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5523d6ed-639a-4ec3-9254-6e56fe7d2dac tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1295 microversion: 2.1 time: 0.165492 Sep 02 04:30:12.487862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 50/94] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:12.549897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c13c077d-910d-4d86-93e1-85d8e9c762e5 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135836 Sep 02 04:30:12.550475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 45/95] 10.222.0.13 () {58 vars in 1188 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:12.563804 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-38f32cb2-55c8-4d80-8e3b-c26010520423 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] Calling method '.version_select at 0x7fa04bf3d5e0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.644171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-38f32cb2-55c8-4d80-8e3b-c26010520423 tempest-VolumesTestJSON-949915620 tempest-VolumesTestJSON-949915620-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084413 Sep 02 04:30:12.644735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 51/96] 10.222.0.13 () {58 vars in 1155 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:12.751837 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.752583 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:12.758870 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.759494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:12.759660 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.760592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.761180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.761879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:12.767859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.768620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:12.769654 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:12.770785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.299665 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.318519 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b03a8a6b-32e4-4c08-9d78-ce4ecad89ccb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.559521 Sep 02 04:30:13.326086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 52/97] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:13.334770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:13.335628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:13.343959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.344684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.345830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.347028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.448749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.460060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.462207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.464003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fa7ab33f-2bc5-4c8c-bf65-c86f4fa2dfbd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.715946 Sep 02 04:30:13.465168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 46/98] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:12 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:13.480951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:13.481826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:13.490522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.491166 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.492453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.493037 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.587413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.596205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bddc302f-3568-4a80-9208-5c9667bfb5bb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.271878 Sep 02 04:30:13.596906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 53/99] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:13 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:13.602707 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-200a0dc4-6f0b-4185-aba9-38ae50ee7fc3 req-f7338055-b9ee-4799-b506-f5a8a6915bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2654621-5e63-4dfe-be2f-855ccb98065b", "tag": "7fc32208-a98b-47a3-922d-4a33035bc09e"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:13.603825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:13.603825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:13.610834 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-200a0dc4-6f0b-4185-aba9-38ae50ee7fc3 req-f7338055-b9ee-4799-b506-f5a8a6915bff service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.611298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-200a0dc4-6f0b-4185-aba9-38ae50ee7fc3 req-f7338055-b9ee-4799-b506-f5a8a6915bff service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.622456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-200a0dc4-6f0b-4185-aba9-38ae50ee7fc3 req-f7338055-b9ee-4799-b506-f5a8a6915bff service nova] Creating event network-changed:7fc32208-a98b-47a3-922d-4a33035bc09e for instance c2654621-5e63-4dfe-be2f-855ccb98065b on hv-cinder-80473 Sep 02 04:30:13.628139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-200a0dc4-6f0b-4185-aba9-38ae50ee7fc3 req-f7338055-b9ee-4799-b506-f5a8a6915bff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029578 Sep 02 04:30:13.628767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 54/100] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:13.634264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:13.634997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:13.641368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.642663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.643428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:13.643858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:13.710089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.717689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f2906bb6-ff4f-4511-ac3a-8e9e0c82d210 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1295 microversion: 2.1 time: 0.087526 Sep 02 04:30:13.718258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 55/101] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:13 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:13.866364 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:13.875473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8cbc4a53-cd62-46fb-8af9-915505d490b5 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.408577 Sep 02 04:30:13.877272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 47/102] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:13 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:14.347196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:14.349019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:14.357451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.358037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.367427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.368356 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.484819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:14.486262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:14.498244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.499863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.503044 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.505126 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.584635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:14.591860 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f0da75ee-492a-4dcb-bfd8-be364026c795 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.254458 Sep 02 04:30:14.592638 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 56/103] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:14 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:14.664647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-f7ef613e-25dc-47a6-b745-77e857c82262 req-1b1ce0e8-f474-4d54-a91f-c0ca59405bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91f6e8-1260-4e45-afc2-e02c3250f91b", "name": "network-vif-plugged", "status": "completed", "tag": "3c711505-4162-4e0a-af45-c6ecdc0466d0"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:14.666770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:14.666770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:14.683174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-f7ef613e-25dc-47a6-b745-77e857c82262 req-1b1ce0e8-f474-4d54-a91f-c0ca59405bc6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.683446 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-f7ef613e-25dc-47a6-b745-77e857c82262 req-1b1ce0e8-f474-4d54-a91f-c0ca59405bc6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.700039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-f7ef613e-25dc-47a6-b745-77e857c82262 req-1b1ce0e8-f474-4d54-a91f-c0ca59405bc6 service nova] Creating event network-vif-plugged:3c711505-4162-4e0a-af45-c6ecdc0466d0 for instance 7e91f6e8-1260-4e45-afc2-e02c3250f91b on hv-cinder-80473 Sep 02 04:30:14.706758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-f7ef613e-25dc-47a6-b745-77e857c82262 req-1b1ce0e8-f474-4d54-a91f-c0ca59405bc6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112666 Sep 02 04:30:14.710091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 57/104] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:14.716131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:14.720146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:14.743118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.743118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.756611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.758840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.950843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:14.960500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-01d438a0-ded2-4a86-8836-e703e9cce056 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.251207 Sep 02 04:30:14.961136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 58/105] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:14 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:14.966370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:14.967452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:14.974925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.975371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:14.976916 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:14.977634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.012428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.020930 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.039704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.042568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2f7f9d11-fd3a-4e8f-8fbf-00e14030fddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.563290 Sep 02 04:30:15.043500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 48/106] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:14 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:15.063853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:15.065213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:15.081680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.082140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.085589 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.086056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.185450 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.193530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f5dc111b-7697-49ad-a37e-f80cb772434f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.231243 Sep 02 04:30:15.195270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 59/107] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:14 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:15.609675 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:15.610406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:15.616919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.617451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.618296 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.618803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.781551 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.798392 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2eef728c-5b7b-4e4b-b8d3-4132df7e95d3 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.192387 Sep 02 04:30:15.800988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 60/108] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:15 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:15.806022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-c6924d5c-c9ea-41c5-897a-1a26eef40661 req-e658c15b-3737-4faa-a393-5f246b5c2b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:15.807580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:15.807580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:15.814966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:15.818171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-c6924d5c-c9ea-41c5-897a-1a26eef40661 req-e658c15b-3737-4faa-a393-5f246b5c2b6e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.818983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-c6924d5c-c9ea-41c5-897a-1a26eef40661 req-e658c15b-3737-4faa-a393-5f246b5c2b6e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.824447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-028f2a72-70d8-4b4d-9596-50dabf5f1f3f tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.776291 Sep 02 04:30:15.831767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-c6924d5c-c9ea-41c5-897a-1a26eef40661 req-e658c15b-3737-4faa-a393-5f246b5c2b6e service nova] Creating event network-changed:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:30:15.834338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 49/109] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:15 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:15.836959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-c6924d5c-c9ea-41c5-897a-1a26eef40661 req-e658c15b-3737-4faa-a393-5f246b5c2b6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034614 Sep 02 04:30:15.837655 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 61/110] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:15.978076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:15.978693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:15.990189 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.990744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:15.991693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:15.992139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.062918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:16.064554 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:16.072411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.072911 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.073961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.074454 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.323598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:16.339408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:16.341242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:16.342484 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5d076f7c-39aa-470a-a08f-704715489d11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.285025 Sep 02 04:30:16.345500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 62/111] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:16 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:16.349965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:16.350761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:16.371337 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.386656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.387692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.388174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.559239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:16.569118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-993e80ff-aa38-4391-bf6b-744032ce88cc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.594950 Sep 02 04:30:16.572774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 50/112] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:15 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:16.582742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:16.594173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e3f48998-018d-4086-8e3a-fed0b37123b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.247597 Sep 02 04:30:16.595686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 63/113] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:16 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:16.737100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7102e2-bb80-4a08-8689-fe3c5678fb83", "name": "network-vif-plugged", "status": "completed", "tag": "7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb"}, {"server_uuid": "3ffde743-fe81-4cab-9344-57ca521c59f4", "name": "network-vif-plugged", "status": "completed", "tag": "3146d225-6bdc-4864-a93a-c0e1301bc12c"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:16.738881 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:16.738881 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:16.747742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.748443 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.762252 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] Creating event network-vif-plugged:7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb for instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 on hv-cinder-80473 Sep 02 04:30:16.762757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] Creating event network-vif-plugged:3146d225-6bdc-4864-a93a-c0e1301bc12c for instance 3ffde743-fe81-4cab-9344-57ca521c59f4 on hv-cinder-80473 Sep 02 04:30:16.777302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-9d70a88f-4116-4377-ac4c-9efeb704dd30 req-1b853a25-da3f-498b-b10f-1d5cef7612cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044950 Sep 02 04:30:16.777960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 51/114] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:16.818847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:16.819499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:16.825424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.829494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.829494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.829494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.841840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:16.842603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:16.848715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.849183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.849966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:16.850392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:16.997840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.006432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-37165ce9-25ce-460b-bc43-7c0684ccfb26 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1318 microversion: 2.1 time: 0.191265 Sep 02 04:30:17.007165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 64/115] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:16 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:17.206440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.213699 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0a341daf-31e3-4009-953c-82b34e375010 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.376019 Sep 02 04:30:17.214272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 52/116] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:16 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:17.378342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:17.379023 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:17.385480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.386158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.386999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.387484 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.571650 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.580292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.581839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.582876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-780347d5-3417-46a5-83d1-c02549d8a0a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.208916 Sep 02 04:30:17.584866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 65/117] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:17 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:17.595739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:17.596394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:17.611638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.612168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.612445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:17.612975 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.613143 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:17.613418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.620617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.621347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.622403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.623047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.787630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.795290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3b3cac30-81c4-406b-81c2-ed3248a55d8c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.187207 Sep 02 04:30:17.800243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 66/118] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:17 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:17.800478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:17.807172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ba2b9d1c-5a5e-46af-b1f9-3e0d542e3b76 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.220824 Sep 02 04:30:17.807762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 53/119] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:17 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:17.854362 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-92aa3eb4-bdfd-425b-89c9-780edfd790b0 req-8cf2f30c-0b06-4316-87a3-b722c3cb1285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fdfd22-1160-4f16-ad90-ec2fd5150229", "tag": "eae12a40-174f-4aa8-b249-61f0b2903ae6"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:17.856091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:17.856091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:17.862764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-92aa3eb4-bdfd-425b-89c9-780edfd790b0 req-8cf2f30c-0b06-4316-87a3-b722c3cb1285 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:17.863202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-92aa3eb4-bdfd-425b-89c9-780edfd790b0 req-8cf2f30c-0b06-4316-87a3-b722c3cb1285 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:17.873939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-92aa3eb4-bdfd-425b-89c9-780edfd790b0 req-8cf2f30c-0b06-4316-87a3-b722c3cb1285 service nova] Creating event network-changed:eae12a40-174f-4aa8-b249-61f0b2903ae6 for instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 on hv-cinder-80473 Sep 02 04:30:17.879502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-92aa3eb4-bdfd-425b-89c9-780edfd790b0 req-8cf2f30c-0b06-4316-87a3-b722c3cb1285 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029047 Sep 02 04:30:17.880114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 67/120] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:18.023615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:18.024383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:18.030410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.030857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.031623 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.032248 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.187985 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:18.196028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-98b39b93-b5c7-4c90-b3d5-c9f5c12268aa tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1508 microversion: 2.1 time: 0.176010 Sep 02 04:30:18.196595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 54/121] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:18 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:18.231528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:18.232501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:18.240359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.241009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.241954 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.243024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.407301 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:18.416775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b46b6f38-de55-42bc-9f75-5f5f985407ac tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.190710 Sep 02 04:30:18.418039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 68/122] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:18 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:18.607498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:18.608148 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:18.615600 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.616082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.617008 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.617447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.800437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-e788b042-65f3-416a-a627-7104f07a1104 req-d85622a1-3f3b-44a1-93ef-feae03bccea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2654621-5e63-4dfe-be2f-855ccb98065b", "name": "network-vif-plugged", "status": "completed", "tag": "7fc32208-a98b-47a3-922d-4a33035bc09e"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:18.807639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:18.807639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:18.821242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-e788b042-65f3-416a-a627-7104f07a1104 req-d85622a1-3f3b-44a1-93ef-feae03bccea1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.821764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-e788b042-65f3-416a-a627-7104f07a1104 req-d85622a1-3f3b-44a1-93ef-feae03bccea1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.834615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-e788b042-65f3-416a-a627-7104f07a1104 req-d85622a1-3f3b-44a1-93ef-feae03bccea1 service nova] Creating event network-vif-plugged:7fc32208-a98b-47a3-922d-4a33035bc09e for instance c2654621-5e63-4dfe-be2f-855ccb98065b on hv-cinder-80473 Sep 02 04:30:18.839855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-e788b042-65f3-416a-a627-7104f07a1104 req-d85622a1-3f3b-44a1-93ef-feae03bccea1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044537 Sep 02 04:30:18.840906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 69/123] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:18.846089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:18.847652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:18.854855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.855429 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.859160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:18.859160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:18.983079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:18.991586 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:18.993115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:18.994221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e41091af-6c04-414b-8e9d-c8e380183b3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.394553 Sep 02 04:30:18.994782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 55/124] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:18 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:19.003429 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:19.004636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:19.011397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:19.011971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:19.012819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:19.013315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:19.018935 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:19.026282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bec048b3-cd07-4955-9616-60ddcd67a496 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.184272 Sep 02 04:30:19.026933 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 70/125] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:18 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:19.201925 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:19.209839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8a39eb5d-bb1f-48e4-bd06-94bf804f971f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.214103 Sep 02 04:30:19.210401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 56/126] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:18 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:19.438666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:19.442291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:19.447760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:19.448566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:19.449543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:19.450225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:19.582009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:19.589625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-277ed436-07af-4e0a-a322-37de4d098da2 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1314 microversion: 2.1 time: 0.158996 Sep 02 04:30:19.599740 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 71/127] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:19 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:20.012622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:20.013265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:20.020773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.021517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.022906 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.023549 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.045121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:20.046262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:20.056867 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.057732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.058784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.059734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.214045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.220959 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.224217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.225558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-85638c1c-1bdb-466d-912d-b3f8f42b28ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.216678 Sep 02 04:30:20.226425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 57/128] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:20 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:20.249362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:20.251231 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:20.261617 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.262604 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.263560 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.264023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.282521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.300521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5d25d6bd-dcea-4ab2-9e79-41e02bda3d2c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.261518 Sep 02 04:30:20.302671 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 72/129] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:20 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:20.395401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:20.396858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:20.408953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.408953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.408953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.408953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.455839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.463603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ae6c7fa2-da33-4735-84d0-fab28dd8ba27 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1322 microversion: 2.1 time: 0.236053 Sep 02 04:30:20.464255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 58/130] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:20 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:20.607036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:20.608243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:20.615370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.616356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.617356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.618198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.743114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:20.750268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1b48ad9d-5174-48f6-9260-0c65fbc39015 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1501 microversion: 2.1 time: 0.147327 Sep 02 04:30:20.751538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 59/131] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:20 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:20.859239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-50bbab8f-64ed-44de-97df-f18b5c96ae04 req-8f6c5e0e-1ef9-41d1-b118-8d4d10bd33a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "name": "network-vif-plugged", "status": "completed", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:20.862901 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:20.862901 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:20.872992 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-50bbab8f-64ed-44de-97df-f18b5c96ae04 req-8f6c5e0e-1ef9-41d1-b118-8d4d10bd33a6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:20.874212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-50bbab8f-64ed-44de-97df-f18b5c96ae04 req-8f6c5e0e-1ef9-41d1-b118-8d4d10bd33a6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:20.890799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-50bbab8f-64ed-44de-97df-f18b5c96ae04 req-8f6c5e0e-1ef9-41d1-b118-8d4d10bd33a6 service nova] Creating event network-vif-plugged:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:30:20.897058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-50bbab8f-64ed-44de-97df-f18b5c96ae04 req-8f6c5e0e-1ef9-41d1-b118-8d4d10bd33a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044654 Sep 02 04:30:20.897943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 60/132] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:21.244330 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:21.246345 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:21.253646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.254328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.255321 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.255833 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.420715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:21.429769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:21.431823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:21.433030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8fbc529b-a2db-4f36-b674-1de35f4326d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.192844 Sep 02 04:30:21.433701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 61/133] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:21 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:30:21.438889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:21.439612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:21.464530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.465068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.466146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.466678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.607399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:21.624054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1bbe61b8-b14b-4d1d-8cf9-efb753e9e463 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.180798 Sep 02 04:30:21.624054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 62/134] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:21 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:21.624054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:21.624054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:21.625068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c6b1f1e3-2c0e-42de-80a4-508a873650fd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.231178 Sep 02 04:30:21.625068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 73/135] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:30:20 2021] POST /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments => generated 194 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:21.627709 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.627709 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.628420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.628848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.766106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:21.778653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-917641b9-9f91-4ad2-acca-c0f40d02e644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1516 microversion: 2.1 time: 0.161252 Sep 02 04:30:21.779228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 63/136] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:21 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:21.798175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:21.799493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:21.810258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.814120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.814120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:21.814120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:21.860633 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lazy-loading 'flavor' on Instance uuid c2654621-5e63-4dfe-be2f-855ccb98065b {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:30:22.229412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2bfe2761-8e8f-4e00-bfa3-52d420768939 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b/action" status: 200 len: 32 microversion: 2.1 time: 0.432361 Sep 02 04:30:22.229412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 74/137] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:21 2021] POST /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:22.239827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:22.240466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:22.247068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.247663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.248800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.249227 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.402775 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:22.416018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-32c1a907-7b90-4e70-88ed-e4ebffa53828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.176110 Sep 02 04:30:22.416018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 64/138] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:22 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:22.452603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:22.453299 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:22.461832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.462451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.463224 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.463827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.595485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:22.603898 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:22.605409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:22.606508 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-83dd3bc7-a313-47f9-b387-ffb1618ff884 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1405 microversion: 2.20 time: 0.158066 Sep 02 04:30:22.607061 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 75/139] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:22 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:22.634597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:22.635286 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:22.642028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.642744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.643572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.644108 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.679794 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5b42167-8ed8-43ef-b4bd-0d05e9fd2e4d"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:22.680317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:22.686226 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.686660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.687692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.688995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.881732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:22.889793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-af481e20-759b-443e-b687-33d7c064942e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.259197 Sep 02 04:30:22.890595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 65/140] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:22 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:22.913466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-e61e2c23-cf39-477e-bad7-9362f369bdf1 req-cdf59287-2823-42b8-85b9-32370afb2c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdfd22-1160-4f16-ad90-ec2fd5150229", "name": "network-vif-plugged", "status": "completed", "tag": "eae12a40-174f-4aa8-b249-61f0b2903ae6"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:22.915046 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:22.915046 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:22.923567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-e61e2c23-cf39-477e-bad7-9362f369bdf1 req-cdf59287-2823-42b8-85b9-32370afb2c96 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:22.924258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-e61e2c23-cf39-477e-bad7-9362f369bdf1 req-cdf59287-2823-42b8-85b9-32370afb2c96 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:22.935358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-e61e2c23-cf39-477e-bad7-9362f369bdf1 req-cdf59287-2823-42b8-85b9-32370afb2c96 service nova] Creating event network-vif-plugged:eae12a40-174f-4aa8-b249-61f0b2903ae6 for instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 on hv-cinder-80473 Sep 02 04:30:22.944615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-e61e2c23-cf39-477e-bad7-9362f369bdf1 req-cdf59287-2823-42b8-85b9-32370afb2c96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035250 Sep 02 04:30:22.945150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 66/141] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:23.431467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:23.432274 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:23.438275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.438743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.439509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.443580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.604665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:23.611781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-02ec4eee-8a79-4c59-95e7-7812013a1e2b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.184711 Sep 02 04:30:23.612375 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 67/142] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:23 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:23.623236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:23.623842 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:23.629935 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.630519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.631262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.631692 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.774115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:23.786106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:23.787664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:23.788893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-beb0537d-b9ee-4007-8d3b-1efe92354d27 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1598 microversion: 2.20 time: 0.169221 Sep 02 04:30:23.789495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 68/143] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:30:23 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:23.808987 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:23.809400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:23.815860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.816328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.817073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.817495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.877327 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b73b9573-341f-4701-8e2e-73aef9f1a608 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "POST /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202460 Sep 02 04:30:23.878227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 76/144] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:30:22 2021] POST /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:23.909128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:23.909805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:23.917657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.918329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.919349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:23.920017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:23.949801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6de13d48-6b6a-470f-9885-39213a77b7b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143305 Sep 02 04:30:23.949801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 69/145] 10.222.0.13 () {60 vars in 1316 bytes} [Thu Sep 2 04:30:23 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:30:24.048222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:24.055937 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7320c7c3-960a-488d-8d07-67b5413eaa80 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.151958 Sep 02 04:30:24.056496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 77/146] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:23 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:24.628686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:24.629409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:24.635259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:24.635766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:24.636567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:24.637090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:24.882590 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:24.889931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9a91f0a8-dd37-4eac-9e0b-5f54efa19d4d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.265425 Sep 02 04:30:24.890513 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 70/147] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:24 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:25.075089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:25.075719 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:25.088481 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.089007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.092335 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.094837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.240713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:25.247985 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b126fafd-3c10-4b21-b896-3de343a158fe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1362 microversion: 2.1 time: 0.179102 Sep 02 04:30:25.248563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 78/148] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:25 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:25.472339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:25.473283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:25.475321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-19e4474b-39ea-45de-84b0-9034407e2614 req-2fc3f5da-4acd-4b3e-8e69-ee217d7af74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:25.476930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:25.476930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:25.479357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.481428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.481428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.481428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.496228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-19e4474b-39ea-45de-84b0-9034407e2614 req-2fc3f5da-4acd-4b3e-8e69-ee217d7af74a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.496663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-19e4474b-39ea-45de-84b0-9034407e2614 req-2fc3f5da-4acd-4b3e-8e69-ee217d7af74a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.510036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-19e4474b-39ea-45de-84b0-9034407e2614 req-2fc3f5da-4acd-4b3e-8e69-ee217d7af74a service nova] Creating event network-changed:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:30:25.522047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-19e4474b-39ea-45de-84b0-9034407e2614 req-2fc3f5da-4acd-4b3e-8e69-ee217d7af74a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049522 Sep 02 04:30:25.528067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 79/149] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:25.667304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7d1c98cb-83a3-4704-abc1-78d5e8e2b640 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.199421 Sep 02 04:30:25.668284 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 71/150] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:25 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:25.907015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:25.907702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:25.913961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.914482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:25.915415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:25.915989 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.141494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:26.150106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9165cfe7-a242-4a96-a0e3-c8e4f40edd61 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.247342 Sep 02 04:30:26.161137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 80/151] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:25 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:26.265396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:26.266201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:26.274669 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.275139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.276149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.278896 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.419829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:26.429252 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-98e4a1dc-6c89-4c77-bf75-4c6c11cf9eb3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1547 microversion: 2.1 time: 0.166736 Sep 02 04:30:26.430282 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 72/152] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:26 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:26.448873 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:26.450051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:26.458705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.459404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.460346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.460934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.552502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9046ff1b-56f4-4ba7-bacd-cb9c8eb7c56e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107681 Sep 02 04:30:26.554090 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 81/153] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Sep 2 04:30:26 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:26.680574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:26.681627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:26.688686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.689370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.690538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:26.691175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:26.798405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d083b331-ff0d-4755-bd03-08b3f210c7f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.122311 Sep 02 04:30:26.799599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 73/154] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:26 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:27.168915 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:27.170025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:27.177766 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.180084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.181136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.181575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.371695 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:27.380315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5ab83483-2118-43ab-b14a-b9f5c3c10574 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.216367 Sep 02 04:30:27.380908 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 82/155] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:27 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:27.810625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:27.811778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:27.818256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.818836 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.819697 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.820254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.943856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cfeaba37-d349-4fa7-b6e0-29f78a681252 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.137334 Sep 02 04:30:27.945128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 74/156] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:27 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:27.951637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-da474df1-35b4-480b-bcae-f5cb438a7c24 req-050c240f-3e62-43a2-8536-4af05d1d3076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fdfd22-1160-4f16-ad90-ec2fd5150229", "tag": "eae12a40-174f-4aa8-b249-61f0b2903ae6"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:27.956738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:27.956738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:27.960786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.961223 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.962046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.962480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:27.965654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:27.965654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:27.975764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-da474df1-35b4-480b-bcae-f5cb438a7c24 req-050c240f-3e62-43a2-8536-4af05d1d3076 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:27.988836 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-da474df1-35b4-480b-bcae-f5cb438a7c24 req-050c240f-3e62-43a2-8536-4af05d1d3076 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:28.009558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-da474df1-35b4-480b-bcae-f5cb438a7c24 req-050c240f-3e62-43a2-8536-4af05d1d3076 service nova] Creating event network-changed:eae12a40-174f-4aa8-b249-61f0b2903ae6 for instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 on hv-cinder-80473 Sep 02 04:30:28.019233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-da474df1-35b4-480b-bcae-f5cb438a7c24 req-050c240f-3e62-43a2-8536-4af05d1d3076 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071235 Sep 02 04:30:28.025039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 75/157] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:28.167202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-67b7b623-71e0-4a65-aae3-88accd3c1285 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.228147 Sep 02 04:30:28.167958 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 83/158] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:27 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:28.402607 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:28.404399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:28.414429 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:28.415080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:28.416392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:28.417052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:28.649834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:28.664310 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3a78c530-465e-49b0-bca5-386dd0748a07 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.268559 Sep 02 04:30:28.666979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 76/159] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:28 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:28.968597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:28.970483 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:28.978490 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:28.978930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:28.980173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:28.980808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.084443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2a74c135-73a6-4c6e-a26c-3a717fab3210 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.128318 Sep 02 04:30:29.087708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 84/160] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:28 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:29.190819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:29.191730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:29.206522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.206522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.206522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.206522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.264228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1997109803", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:29.329045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-da487eb9-d54d-4add-a9dc-559e5a78b44a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.133691 Sep 02 04:30:29.329045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 77/161] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:29 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:29.345734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] validate_networks() for None {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:29.621062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:29.621504 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:29.621997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:29.622405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:29.622920 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:29.632117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.632612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.633445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.633885 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.650328 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Getting quotas for project d30f982efcf34666bc009a926ca5fa78. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:29.654354 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Getting quotas for user 8b16503f535744379ac1bad7e13f6826 and project d30f982efcf34666bc009a926ca5fa78. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:29.665069 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:29.667557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:29.683240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:29.684352 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:29.691498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.692085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.693313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:29.694701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:29.823816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:29.831808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-73602e0c-2684-4867-850b-f521f130a948 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.153013 Sep 02 04:30:29.832544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 78/162] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:29 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:29.898040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0307302d-782e-49b2-b566-504dd9a99bdf tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637971 Sep 02 04:30:29.898835 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 85/163] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:30:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 04:30:29.908894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0bf4abe1-cd5a-4cfe-a105-aee7241c2d7f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:29.909781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0bf4abe1-cd5a-4cfe-a105-aee7241c2d7f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:29.970417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0bf4abe1-cd5a-4cfe-a105-aee7241c2d7f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:29.979603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0bf4abe1-cd5a-4cfe-a105-aee7241c2d7f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1215 microversion: 2.1 time: 0.074792 Sep 02 04:30:29.980629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 79/164] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:29 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:30.095373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:30.096533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:30.103614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.104122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.104909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.105343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.209405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6639284d-74cb-4d82-9e96-7e6630c4778d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.117971 Sep 02 04:30:30.212388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 86/165] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:30 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:30.332050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:30.333052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:30.338808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.339433 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.342892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.342892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.459158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-81ce4ab8-5b6f-41a7-acbf-77437f778f6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.131615 Sep 02 04:30:30.462409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 80/166] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:30 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:30.849580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:30.850299 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:30.857444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.857880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.858625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:30.859178 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:30.991294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:30.997135 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4342948e-9981-4cd0-8249-e380e9761b64 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:30.998066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4342948e-9981-4cd0-8249-e380e9761b64 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:31.001612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d1b9d96e-14ad-4c3b-9e01-43204018c4e2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.155988 Sep 02 04:30:31.002300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 87/167] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:30 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:31.058748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4342948e-9981-4cd0-8249-e380e9761b64 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:31.066688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4342948e-9981-4cd0-8249-e380e9761b64 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1215 microversion: 2.1 time: 0.073655 Sep 02 04:30:31.067253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 81/168] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:30 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:31.220609 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:31.221839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:31.228117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:31.228560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:31.229315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:31.229741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:31.364403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-630c8283-ced9-4022-a6b1-ea99c2c10740 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.147817 Sep 02 04:30:31.365034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 88/169] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:31 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:31.470294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:31.471307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:31.478751 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:31.479221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:31.480043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:31.480478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:31.589274 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bc875a16-bf50-4041-b268-2e7c1d37e831 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.123391 Sep 02 04:30:31.592825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 82/170] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:31 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:32.019953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:32.021268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:32.031034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.035848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.035848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.035848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.082961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:32.083648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:32.090209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.090689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.091454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.091886 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.154474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:32.162073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b908e287-ab60-45ce-ae86-9532033a896f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1267 microversion: 2.1 time: 0.083068 Sep 02 04:30:32.162817 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 83/171] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:32 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:32.170029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:32.177439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-838fa6a5-95b1-4d14-916d-5ab8e6357495 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.162621 Sep 02 04:30:32.177989 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 89/172] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:32 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:32.374611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:32.375670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:32.381447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.381891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.382654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.383082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.532834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-61abbc29-300f-4756-8252-15bdacf816ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.161661 Sep 02 04:30:32.533573 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 84/173] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:32 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:32.601151 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:32.602677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:32.609956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.610391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.611130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:32.611557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:32.732344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a9bd5a7-b774-42b2-882d-1b4a832bc592 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.134718 Sep 02 04:30:32.755289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 90/174] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:32 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:33.157627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1419268006", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "26ff5384-f842-4306-a318-71b587753ace"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:33.183069 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:33.184007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:33.191270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.191654 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.192860 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.193754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.216574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] validate_networks() for [('26ff5384-f842-4306-a318-71b587753ace', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:33.266505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:33.275419 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-191ce97a-e32c-460b-b957-ff95e97a7921 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1275 microversion: 2.1 time: 0.096573 Sep 02 04:30:33.278544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 91/175] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:33 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:33.299861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:33.300636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:33.309444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.310597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.312246 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.313125 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.460845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:33.469782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0b393429-c9db-4ea0-87bb-975fb0cfff91 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.188376 Sep 02 04:30:33.480395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 92/176] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:33 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:33.542930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:33.543839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:33.549711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.550151 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.550904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.551329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.710640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3033db54-ec0d-48f1-80d8-bc712d96df7a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.168844 Sep 02 04:30:33.711321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 93/177] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:33 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:33.766782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:33.767791 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:33.774521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.774966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.775729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.776220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.852215 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:33.852215 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:33.852823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:33.852823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:33.853197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:33.862362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.862801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.863676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:33.864203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:33.881606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:33.886105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for user c05601393e5948458fd6e350520776c5 and project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:33.897825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:33.900357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:33.947929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1496da56-053b-4fa7-86be-9ccd613dd628 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.185548 Sep 02 04:30:33.951332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 94/178] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:33 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:34.007307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a254278e-953d-4a86-9459-6259fc288728 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853322 Sep 02 04:30:34.007307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 85/179] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:30:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:30:34.018795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a9bfcdb1-6953-402b-858e-8e0b015fa674 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:34.018795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a9bfcdb1-6953-402b-858e-8e0b015fa674 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:34.077189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a9bfcdb1-6953-402b-858e-8e0b015fa674 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:34.085095 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a9bfcdb1-6953-402b-858e-8e0b015fa674 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1218 microversion: 2.1 time: 0.071913 Sep 02 04:30:34.085823 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 95/180] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:34 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:34.298907 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:34.299761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:34.306549 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.307581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.308629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.309215 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.403391 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:34.411209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-50c92a7f-ce17-42f8-baac-5204d9f138eb tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1273 microversion: 2.1 time: 0.118005 Sep 02 04:30:34.411774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 86/181] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:34 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:34.487056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:34.487659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:34.494239 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.494684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.495436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.495926 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.632801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:34.640195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f38ee29f-696a-47ce-9ae8-ea8b00e55247 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.157274 Sep 02 04:30:34.642742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 96/182] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:34 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:34.721842 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:34.723118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:34.731015 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.731468 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.732277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.732878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.855946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1d8d68d2-b927-44de-9546-7ef7d781917a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.137599 Sep 02 04:30:34.856606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 87/183] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:34 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:34.958563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:34.959474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:34.966062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.966506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:34.970067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:34.970067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.102558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a48c918-aa1c-40ca-a65f-7930920c764b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.147315 Sep 02 04:30:35.102784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:35.103413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:35.104220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 97/184] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:34 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:35.111884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.112476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.113546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.114225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.209622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:35.216847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1313b688-f9e9-4d4d-8ba8-f9044d6694e8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1222 microversion: 2.1 time: 0.118402 Sep 02 04:30:35.226122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 88/185] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:35 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:35.432459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:35.433123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:35.440167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.440607 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.441358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.441785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.585955 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:35.596116 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-243569e6-014b-49c5-ad61-0717ace72aa3 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.167530 Sep 02 04:30:35.596788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 98/186] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:35 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:35.657613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:35.658312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:35.664584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.665692 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.665933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.666361 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.787465 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:35.795091 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4241de78-e09a-4d54-b20a-705f1679933f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.141302 Sep 02 04:30:35.795642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 89/187] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:35 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:35.866714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:35.867614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:35.873427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.873863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.874605 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.875057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.943400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-7f20c365-4d52-40d3-b92e-4ab0aa69e4a7 req-d415209d-801c-49ad-b8ba-e79abe6bd1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843b6490-8575-4988-a3e4-16835e3960ab", "tag": "077d2e89-136e-4129-8828-d2366fff9d58"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:35.951399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:35.951399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:35.959552 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-7f20c365-4d52-40d3-b92e-4ab0aa69e4a7 req-d415209d-801c-49ad-b8ba-e79abe6bd1b3 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:35.960236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-7f20c365-4d52-40d3-b92e-4ab0aa69e4a7 req-d415209d-801c-49ad-b8ba-e79abe6bd1b3 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:35.975637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-7f20c365-4d52-40d3-b92e-4ab0aa69e4a7 req-d415209d-801c-49ad-b8ba-e79abe6bd1b3 service nova] Creating event network-changed:077d2e89-136e-4129-8828-d2366fff9d58 for instance 843b6490-8575-4988-a3e4-16835e3960ab on hv-cinder-80473 Sep 02 04:30:35.984169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-7f20c365-4d52-40d3-b92e-4ab0aa69e4a7 req-d415209d-801c-49ad-b8ba-e79abe6bd1b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042669 Sep 02 04:30:35.986929 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 90/188] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:36.093051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d62761dc-c3be-49b3-be3a-6ba9ffa1d44a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.226595 Sep 02 04:30:36.093051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 99/189] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:35 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:36.118627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:36.119645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:36.126515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.127478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.127944 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.128387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.240158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:36.241048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:36.249665 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.250983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.252258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.252802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.277342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c8ad6818-8fb0-4f78-88b1-92ee77673af0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.162925 Sep 02 04:30:36.278436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 91/190] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:36 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:36.321566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:36.330214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0dd5f2d4-3e27-4b89-8418-790780af9e7c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1270 microversion: 2.1 time: 0.094174 Sep 02 04:30:36.330801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 100/191] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:36 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:36.613946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:36.614731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:36.629829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.633432 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.634593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.635023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.797918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:36.815031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:36.816029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:36.819148 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1225aeb6-2a21-4c0d-a4b0-436593c87e1e tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.198502 Sep 02 04:30:36.822482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.822931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.823692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:36.824146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:36.824965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 92/192] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:36 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:36.997933 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:37.006932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-14fbe67f-bf1f-40b3-a6f1-d6ad5add1282 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.196900 Sep 02 04:30:37.012369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 101/193] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:36 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:37.100968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:37.102865 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:37.114778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.115394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.116356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.117008 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.285876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-92141d62-5e93-4ad6-8019-115123a0e1a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.182704 Sep 02 04:30:37.285876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 93/194] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:37 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:37.289925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:37.290961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:37.298724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.300721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.302071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.302715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.349109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:37.349916 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:37.356893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.357566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.358333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.358755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.449029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4da4f55b-7252-4520-b60e-c03c255d2c81 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.163606 Sep 02 04:30:37.449825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 102/195] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:37 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:37.450899 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:37.459734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a7ad5387-c589-4697-a492-d21aaca9bbb8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1288 microversion: 2.1 time: 0.115638 Sep 02 04:30:37.461814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 94/196] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:37 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:37.846911 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:37.847640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:37.854493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.855290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.856096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:37.856527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:37.980389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:37.987493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1ff4f7e8-7e08-4034-9904-be646573a626 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.146926 Sep 02 04:30:37.988128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 103/197] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:37 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:38.029703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:38.030242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:38.039137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.039973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.040742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.041368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.198726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:38.206861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0e7a202c-a95e-4a33-aebb-ff1e59d64930 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.184182 Sep 02 04:30:38.207456 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 95/198] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:38 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:38.293560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:38.294713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:38.302097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.302940 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.304172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.304803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.443195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d557e4b5-931e-4c64-ac59-0817b7710c30 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.153033 Sep 02 04:30:38.446616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 104/199] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:38 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:38.460626 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:38.461646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:38.468359 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.468809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.469785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.470531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.487492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:38.488320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:38.501358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.505103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.505103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:38.505103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:38.649688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:38.649839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-84240449-db0a-42ca-8e1f-3efd6996bef0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.192077 Sep 02 04:30:38.649839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 96/200] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:38 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:38.657067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8a6cbe9e-b7bc-4458-9183-8acbae3c8760 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.174073 Sep 02 04:30:38.657632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 105/201] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:38 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:39.005153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:39.005848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:39.012298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.012748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.013513 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.013954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.035240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-7f08a736-4665-4aca-a916-c840b060ad6c req-0152c48e-78cf-457f-a51c-425508a2c56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f6d300-6517-4e4b-9e8e-be0fab5c385c", "tag": "cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:39.036827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:39.036827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:39.044219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-7f08a736-4665-4aca-a916-c840b060ad6c req-0152c48e-78cf-457f-a51c-425508a2c56e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.044657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-7f08a736-4665-4aca-a916-c840b060ad6c req-0152c48e-78cf-457f-a51c-425508a2c56e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.056280 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-7f08a736-4665-4aca-a916-c840b060ad6c req-0152c48e-78cf-457f-a51c-425508a2c56e service nova] Creating event network-changed:cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7 for instance 62f6d300-6517-4e4b-9e8e-be0fab5c385c on hv-cinder-80473 Sep 02 04:30:39.062172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-7f08a736-4665-4aca-a916-c840b060ad6c req-0152c48e-78cf-457f-a51c-425508a2c56e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032257 Sep 02 04:30:39.062810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 106/202] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:39.176994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:39.184329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7adaeadb-2d4a-40dd-b7e8-bb9a6ea3fbe4 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.183217 Sep 02 04:30:39.184896 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 97/203] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:38 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:39.223301 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:39.224322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:39.230738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.231186 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.231983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.232418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.372781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:39.380040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a3a1e705-6339-4f37-bd5a-26b0bf484614 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.160633 Sep 02 04:30:39.380601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 107/204] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:39 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:39.456746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:39.457664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:39.463342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.463786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.464686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.465119 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.594741 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-32bde8e6-954c-449f-850d-911ceac31327 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.141417 Sep 02 04:30:39.595369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 98/205] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:39 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:39.660087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:39.661143 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:39.667234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.667679 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.669043 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.669482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.674152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:39.674857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:39.681213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.681658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.682661 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:39.683098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:39.822617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e77230e8-c1da-49ff-945c-31d2df9ed2e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.166527 Sep 02 04:30:39.823681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 108/206] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:39 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:39.841707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:39.849965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-aede9cb9-5343-43f0-9ecd-1b485ee874f0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.180239 Sep 02 04:30:39.850765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 99/207] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:39 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:40.202662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:40.203395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:40.210278 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.211001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.211848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.212319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.337471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:40.346271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4509dddd-7e6a-4095-999f-e61b219db285 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.148086 Sep 02 04:30:40.346847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 109/208] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:40 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:40.400879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:40.401804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:40.409086 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.409542 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.415255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.415255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.550553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:40.557982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-868e103b-9561-4cdc-8a9d-651c161ec2dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.162348 Sep 02 04:30:40.558551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 100/209] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:40 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:40.610777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:40.611757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:40.618173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.621324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.621324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.621324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.756870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ee20ec4e-4f3f-4b6e-9b7b-6b26af60b424 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.149955 Sep 02 04:30:40.757505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 110/210] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:40 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:40.833779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:40.834852 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:40.841239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.841640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.842396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.842824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.868324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:40.869981 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:40.877086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.877525 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.878291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:40.878717 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:40.968439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-00e7efa7-aae4-4e75-b616-d61fcef5ad26 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.138036 Sep 02 04:30:40.973062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 101/211] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:40 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:41.167047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:41.176108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fe4f7914-f2e0-487c-9ba8-26fa8a164c2c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.312337 Sep 02 04:30:41.176674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 111/212] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:40 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:41.363459 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:41.364417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:41.371518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.372131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.372927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.373362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.499718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:41.507158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c66593e4-8570-4402-9081-999212fb983d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.148394 Sep 02 04:30:41.507720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 102/213] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:41 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:41.574775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:41.575382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:41.582863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.584993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.596286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.596286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.727600 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:41.728791 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:41.742103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.742554 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.743327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.743766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.777272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:30:41.789567 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:41.798833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-857b6362-da9d-4228-aa66-b5a79675e349 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.227598 Sep 02 04:30:41.799678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 112/214] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:41 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:41.804414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:41.805606 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:41.814756 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.815209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.816035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.816488 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.959021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e0efc123-fd7a-4f48-a287-7c03caaee322 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.157597 Sep 02 04:30:41.962378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 113/215] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:41 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:41.980229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:41.981209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:41.988399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.990008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:41.990008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:41.990495 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.135866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3394f657-7875-433c-81ca-4558b37830f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.159645 Sep 02 04:30:42.139216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 114/216] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:41 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:42.192714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:42.193696 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:42.199524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a220256d-71b9-4e8e-8cbd-1dbf6ca7964a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 204 len: 0 microversion: 2.1 time: 0.475446 Sep 02 04:30:42.200347 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 103/217] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:30:41 2021] DELETE /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:30:42.201610 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.202258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.204157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.204769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.222754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:42.223490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:42.242149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.242782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.243704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.244272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.396511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:42.404345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2621c10e-aac4-4978-bf27-21eed7ac6625 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.215605 Sep 02 04:30:42.406488 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 115/218] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:42 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:42.458592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:42.468056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5b1ec7b7-7d6b-4a4f-b6e1-a38cbe49eedc tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1553 microversion: 2.1 time: 0.255879 Sep 02 04:30:42.468996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 104/219] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:42 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:42.524957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:42.525575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:42.533615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.533615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.533615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.537383 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.671159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:42.680254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-871d27ef-bdbf-410c-8caf-ebf9596d2dfc tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.159170 Sep 02 04:30:42.680809 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 116/220] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:42 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:42.816480 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:42.817588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:42.825440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.826118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.827020 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.827591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.951401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:42.963000 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-814eb532-7e1f-4883-8a43-b3603cd4333b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.150614 Sep 02 04:30:42.963828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 105/221] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:42 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:42.978303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:42.979361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:42.985414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.985859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:42.986811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:42.987236 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.100465 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b36f416d-111c-4364-924a-e8c2e43a68be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.127028 Sep 02 04:30:43.101329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 117/222] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:42 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:43.146592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:43.147816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:43.175994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.176689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.177608 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.178190 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.282576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ed0e6705-e842-4e58-b7d2-92549af6b501 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.139487 Sep 02 04:30:43.283608 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 106/223] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:43 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:30:43.422549 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:43.423532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:43.430663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.431154 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.431950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.432390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.487378 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:43.488111 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:43.495606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.496919 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.498547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.499151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.571946 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:43.580209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7a81757b-510a-42b2-a654-ba95dcb1f147 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.161904 Sep 02 04:30:43.580983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 118/224] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:43 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:43.674749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:43.682479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8c8c3b4b-c9ff-40de-93f7-f88d533063e8 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1553 microversion: 2.1 time: 0.200565 Sep 02 04:30:43.683038 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 107/225] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:43 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:43.697605 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:43.698227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:43.704603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.705052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.705815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.706249 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.840149 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:43.843041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e1279c7e-f030-40b1-87e5-081a7444020f tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.149293 Sep 02 04:30:43.853041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 119/226] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:43 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:43.981404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:43.982026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:43.987977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.988421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:43.989169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:43.989592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.112122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:44.113073 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:44.119033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.119482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.120282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.120715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.234899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ddd0cf67-aacb-4d94-9a34-21daf63c4088 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 14 microversion: 2.20 time: 0.126459 Sep 02 04:30:44.235661 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 120/227] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:44 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:44.297502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:44.299627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:44.309540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.310035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.310822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.311255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.398402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:44.409483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f1f2d024-9132-4b06-8315-1fcbf0468d59 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.431748 Sep 02 04:30:44.410170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 108/228] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:43 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:44.414521 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-4f557030-c960-42e4-a792-8bac9f09a0fa req-26c35de6-8804-45ee-a0d1-ee959814a1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b6490-8575-4988-a3e4-16835e3960ab", "name": "network-vif-plugged", "status": "completed", "tag": "077d2e89-136e-4129-8828-d2366fff9d58"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:44.416055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:44.416055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:44.420453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-49ad7f3e-1077-4546-8bc8-1e458c125857 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 14 microversion: 2.1 time: 0.129859 Sep 02 04:30:44.421514 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 121/229] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:44 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:44.428304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-4f557030-c960-42e4-a792-8bac9f09a0fa req-26c35de6-8804-45ee-a0d1-ee959814a1e1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.428895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-4f557030-c960-42e4-a792-8bac9f09a0fa req-26c35de6-8804-45ee-a0d1-ee959814a1e1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.440882 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-4f557030-c960-42e4-a792-8bac9f09a0fa req-26c35de6-8804-45ee-a0d1-ee959814a1e1 service nova] Creating event network-vif-plugged:077d2e89-136e-4129-8828-d2366fff9d58 for instance 843b6490-8575-4988-a3e4-16835e3960ab on hv-cinder-80473 Sep 02 04:30:44.445706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-4f557030-c960-42e4-a792-8bac9f09a0fa req-26c35de6-8804-45ee-a0d1-ee959814a1e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034413 Sep 02 04:30:44.446290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 109/230] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:44.598823 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:44.599988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:44.606907 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.607659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.608546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.608970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.704331 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:44.705022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:44.710889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.711325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.712106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.712544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.734544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:44.741982 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c00cea47-9473-4065-aa4b-7559893976ce tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.148694 Sep 02 04:30:44.742555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 122/231] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:44 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:44.839063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:44.847690 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fe5c37f9-acf4-4267-9aa7-73a7103cd89a tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1553 microversion: 2.1 time: 0.147902 Sep 02 04:30:44.848283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 110/232] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:44 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:44.861062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:44.861668 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:44.867686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.868156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:44.869003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:44.869431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.012815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:45.020617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cc4b27db-d771-4c1a-8b68-016e5efda020 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.163698 Sep 02 04:30:45.021203 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 123/233] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:44 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:45.246043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:45.246962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:45.253285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.253759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.254529 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.254954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.426828 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:45.427410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:45.433456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.433913 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.434764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.435253 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.560660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:45.568352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7b0b468c-b19a-40bd-807b-5fc6596bc6cf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.145467 Sep 02 04:30:45.568909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 124/234] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:45 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:45.573267 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:45.574283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:45.581018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.581567 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.582422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.582897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.588392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9c568a1e-ad84-42a4-b553-1c91807b1663 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 7248 microversion: 2.20 time: 0.346016 Sep 02 04:30:45.600110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 111/235] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:45 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 7248 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:30:45.758689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:45.759380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:45.766792 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.767237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.768052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.768512 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.774975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d8e5d40d-3c16-4cdc-aaa6-64ec9e8f7348 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 1652 microversion: 2.1 time: 0.204834 Sep 02 04:30:45.776276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 125/236] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:45 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 1652 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:45.865287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:45.865976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:45.872005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.872450 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:45.873294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:45.873721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.005397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:46.012874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-68f14260-26b0-4f0f-92ef-9e6df114a2dd tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.258096 Sep 02 04:30:46.013486 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 112/237] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:45 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:46.038875 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:46.039962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:46.046208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.046979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.048053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.048665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.066218 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:46.077284 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-82d10472-03ca-4533-b778-f862e3219cc1 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1553 microversion: 2.1 time: 0.216321 Sep 02 04:30:46.087466 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 126/238] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:45 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:46.283053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:46.292104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-44fe37e9-7ef8-4407-91dc-978c6b53aa30 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1315 microversion: 2.1 time: 0.257091 Sep 02 04:30:46.293040 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 113/239] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:46 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:46.466268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-ddeed0e0-d551-4ea1-94bf-50650117db3c req-b6f069ff-3ac3-4baa-a1bb-430a49a11262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f6d300-6517-4e4b-9e8e-be0fab5c385c", "name": "network-vif-plugged", "status": "completed", "tag": "cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:46.467787 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:46.467787 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:30:46.475636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ddeed0e0-d551-4ea1-94bf-50650117db3c req-b6f069ff-3ac3-4baa-a1bb-430a49a11262 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.476133 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ddeed0e0-d551-4ea1-94bf-50650117db3c req-b6f069ff-3ac3-4baa-a1bb-430a49a11262 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.488463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-ddeed0e0-d551-4ea1-94bf-50650117db3c req-b6f069ff-3ac3-4baa-a1bb-430a49a11262 service nova] Creating event network-vif-plugged:cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7 for instance 62f6d300-6517-4e4b-9e8e-be0fab5c385c on hv-cinder-80473 Sep 02 04:30:46.494083 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-ddeed0e0-d551-4ea1-94bf-50650117db3c req-b6f069ff-3ac3-4baa-a1bb-430a49a11262 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036278 Sep 02 04:30:46.494837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 127/240] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:46.506950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-2adb35b2-0a5d-46bd-b557-b0e2f94459ba req-e26ded65-821b-4d72-b4aa-118aff2de34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7102e2-bb80-4a08-8689-fe3c5678fb83", "name": "network-vif-deleted", "tag": "7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:46.508796 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:46.508796 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:46.515662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-2adb35b2-0a5d-46bd-b557-b0e2f94459ba req-e26ded65-821b-4d72-b4aa-118aff2de34a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.516137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-2adb35b2-0a5d-46bd-b557-b0e2f94459ba req-e26ded65-821b-4d72-b4aa-118aff2de34a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.526464 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-2adb35b2-0a5d-46bd-b557-b0e2f94459ba req-e26ded65-821b-4d72-b4aa-118aff2de34a service nova] Creating event network-vif-deleted:7b7bcf24-6a56-4bd8-85aa-d2f2add51fdb for instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 on hv-cinder-80473 Sep 02 04:30:46.531043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-2adb35b2-0a5d-46bd-b557-b0e2f94459ba req-e26ded65-821b-4d72-b4aa-118aff2de34a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028110 Sep 02 04:30:46.532178 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 114/241] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:46.586574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:46.587529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:46.594077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.594651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.595624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.596154 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.610993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:46.612135 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:46.620478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.621098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.621879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.622308 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.761515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:46.770075 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7ddd0968-640d-4653-be4d-110c8c0e3e04 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.187925 Sep 02 04:30:46.770563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 128/242] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:46 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:46.786992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:46.787932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:46.794097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.794540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.795346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:46.795830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:46.980428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9731b501-baf8-4b47-8d9b-5bb52ecd41df tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 11929 microversion: 2.20 time: 0.374815 Sep 02 04:30:46.981670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 115/243] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:46 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 11929 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:30:47.029969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:47.034746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.045407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.045407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.045407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.045407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.085874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-143ac789-dd84-45d1-abbd-030435f5f0a8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 8392 microversion: 2.1 time: 0.303786 Sep 02 04:30:47.090453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 129/244] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:46 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 8392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:47.100821 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:47.102499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.111593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.112098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.113261 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.113709 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.183730 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:47.192318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-68948441-7502-4154-a9db-5b2ca753eacf tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1345 microversion: 2.1 time: 0.099567 Sep 02 04:30:47.192895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 130/245] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:47 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:47.231663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:47.240010 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e7c94d53-4b74-4b48-a121-73f7ddcc76ba tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.214139 Sep 02 04:30:47.240647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 116/246] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:47 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:47.309348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:47.310156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.316295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.319195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.319195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.319195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.455050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:47.463487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-36f74340-3153-411c-81ab-faedbaa5fa58 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1465 microversion: 2.1 time: 0.157947 Sep 02 04:30:47.464145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 131/247] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:47 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:47.505328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:47.505885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.512027 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.512479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.513259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.513692 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.618460 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:30:47.786833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:47.787611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.793432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.793948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.794701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.795127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.914641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:47.922081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ae9213f6-6a43-4f15-99b9-2ae77c2caab4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.138836 Sep 02 04:30:47.922638 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 132/248] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:47 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:47.991961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:47.992945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:47.998651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:47.999097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:47.999841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.000313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.152931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e8124cb-86ea-4df1-bd43-355b36265054 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 15064 microversion: 2.20 time: 0.164617 Sep 02 04:30:48.154233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 133/249] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:47 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 15064 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:30:48.158895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-017c31d6-ce01-49de-a672-9ffbd1238934 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "DELETE /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 204 len: 0 microversion: 2.1 time: 0.655128 Sep 02 04:30:48.162610 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:48.163741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:48.166003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 117/250] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:30:47 2021] DELETE /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:30:48.170129 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.170677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.171543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.172244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.177346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:48.178078 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:48.183938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.184384 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.185145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.185573 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.307765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:48.314925 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4c6b6293-4ed4-4558-9aca-2c5f2a972857 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1471 microversion: 2.1 time: 0.142007 Sep 02 04:30:48.315518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 118/251] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:48 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:48.319812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:48.320446 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:48.325859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.326297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.327045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.327471 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.359222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.359734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.360233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lazy-loading 'fault' on Instance uuid 9a7102e2-bb80-4a08-8689-fe3c5678fb83 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:30:48.370883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bcfc5144-3d7e-469e-9b42-435cee712519 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 13731 microversion: 2.1 time: 0.215267 Sep 02 04:30:48.371522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 134/252] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:48 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 13731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:48.378431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:48.379127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:48.385474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.386036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.388906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.389380 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.405835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:48.414296 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7abd49a7-0e13-41c0-987d-14240c79b7ea tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1350 microversion: 2.1 time: 0.097667 Sep 02 04:30:48.420028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 119/253] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:48 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:48.534619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:48.542171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-69beb4d9-4881-4fe7-804e-c14023d81e6c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.169341 Sep 02 04:30:48.542731 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 135/254] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:48 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:48.938494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:48.939198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:48.945123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.945589 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:48.946358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:48.946790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.066346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:49.073668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c46a2129-83eb-4d54-99be-3816a21ab01f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.138909 Sep 02 04:30:49.074233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 120/255] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:48 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:49.164672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:49.165579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:49.171286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.171728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.173041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.173472 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.332111 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:49.332746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:49.338499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.338939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.339725 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.340145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.421127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dddb0787-2003-49fd-a31b-752ce1e673e8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 17602 microversion: 2.20 time: 0.259870 Sep 02 04:30:49.421777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 136/256] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:49 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 17602 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:49.426630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:49.427640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:49.434122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.434564 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.435325 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.435753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.465262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:49.472873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-110ecc64-2854-4df3-b9ca-13f554fed1ba tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1471 microversion: 2.1 time: 0.144362 Sep 02 04:30:49.473443 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 121/257] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:49 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:49.477978 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:49.482563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:49.484582 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.485046 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.485834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.486264 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.516618 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.517141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.517584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lazy-loading 'fault' on Instance uuid 9a7102e2-bb80-4a08-8689-fe3c5678fb83 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:30:49.558957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb043c7f84643fc9d5ad2cdbcf15dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b6525c725444b7aa20bdb9a47c55f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:49.566197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7020bdf2-2ac8-4782-839c-8d8c8024385c tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 200 len: 1304 microversion: 2.1 time: 0.091791 Sep 02 04:30:49.566782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 122/258] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:49 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:49.573149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:49.573149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:49.579658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.580140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.580905 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:49.581338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:49.598413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fd10f513-6b7d-4895-b727-8a119d371a05 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 16208 microversion: 2.1 time: 0.175180 Sep 02 04:30:49.599055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 137/259] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:49 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 16208 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:49.706372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:49.713561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ef6f04fb-8795-4577-9d9b-bd95ff6f9072 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1318 microversion: 2.1 time: 0.145856 Sep 02 04:30:49.714128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 123/260] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:49 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:50.091298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:50.091962 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.098867 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.099312 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.100103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.100533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.221493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:50.229002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dd249b30-d39e-4d47-baed-4a97cc070fcd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.141823 Sep 02 04:30:50.229591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 138/261] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:50 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:50.432756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:50.433695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.440087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.440536 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.441289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.441715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.490415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:50.491021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.496933 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.497376 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.498124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.498553 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.585743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-06b0c0e3-ff89-4fbc-89e3-180022193a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 17602 microversion: 2.20 time: 0.156535 Sep 02 04:30:50.586713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 124/262] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:50 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 17602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:50.591439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:50.592164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.598873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.599321 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.600108 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.600538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.615509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] HTTP exception thrown: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. Sep 02 04:30:50.616118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Returning 404 to user: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:50.616946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5629cf69-af84-41db-8299-0cf5626fbc58 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 404 len: 111 microversion: 2.1 time: 0.029211 Sep 02 04:30:50.617486 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 125/263] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:50 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:30:50.619602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:50.622093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:50.623032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.628669 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.629095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.629853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.631616 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.632557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0d9387d9-486f-45a6-bb1d-3a5ef19c112b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1471 microversion: 2.1 time: 0.145792 Sep 02 04:30:50.633464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 139/264] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:50 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:50.737580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:50.738543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.744268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.747046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.747046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.747046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.759229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] HTTP exception thrown: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. Sep 02 04:30:50.759894 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Returning 404 to user: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:50.760736 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a25684b-de0d-4efd-bb48-d1cc690ccade tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026945 Sep 02 04:30:50.761270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 140/265] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:30:50 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:30:50.766979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:50.767667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.773745 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.774192 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.775062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.775501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.786586 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3c4e25d0-6921-4723-8153-75da885e11fb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 17960 microversion: 2.1 time: 0.167869 Sep 02 04:30:50.787533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 126/266] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:50 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 17960 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:50.905949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:50.913838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b5f1e1e1-8b20-44ee-a614-20c047195f87 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1507 microversion: 2.1 time: 0.150834 Sep 02 04:30:50.917007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 141/267] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:50 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:50.930909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:50.932088 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:50.947250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.947250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:50.947250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:50.947250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.107855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Invalid volume: volume 8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a is already attached to instances: 7e91f6e8-1260-4e45-afc2-e02c3250f91b Sep 02 04:30:51.108485 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 400 to user: Invalid volume: volume 8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a is already attached to instances: 7e91f6e8-1260-4e45-afc2-e02c3250f91b {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:51.109939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ef465cf5-ea55-4fec-8d02-7379c8ddaf1e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.182927 Sep 02 04:30:51.110496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 127/268] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:30:50 2021] POST /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c/os-volume_attachments => generated 174 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:30:51.195879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:51.196450 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.206489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.206949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.207718 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.208244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.246130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:51.247250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.254890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.255352 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.256164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.256644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.386423 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:51.396941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ea996c7a-8234-440e-a03c-28163a9ebaaf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.154826 Sep 02 04:30:51.397518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 128/269] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:51 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:30:51.474799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'services' on Instance uuid 7e91f6e8-1260-4e45-afc2-e02c3250f91b {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:30:51.597766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:51.598803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.607092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.607092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.607092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.607544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.749137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-53cfc9ad-d149-4cf7-9bc7-8299bb4df532 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 19342 microversion: 2.20 time: 0.155432 Sep 02 04:30:51.753537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 129/270] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:51 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 19342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:30:51.755128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:51.760941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.762230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.762674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.763435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.763856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.823415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7c37e59e-8ad1-4653-921b-6d35267098e0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments/8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a" status: 202 len: 0 microversion: 2.1 time: 0.629364 Sep 02 04:30:51.824332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 142/271] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:30:51 2021] DELETE /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments/8d2aeec4-0f15-416a-b6d4-3cd84e9ed00a => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:51.831059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:51.832224 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.839736 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.840310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.841179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.841711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.895240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:51.902555 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-346b1848-c0bf-45bf-a0d5-1b14616a099d tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1471 microversion: 2.1 time: 0.151143 Sep 02 04:30:51.903115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 130/272] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:51 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:51.907624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:51.908619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:51.915579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.916047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.920281 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:51.920281 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:51.958785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d1abfc29-6493-4d6a-a120-5f4fffeac1da tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050220 Sep 02 04:30:51.958785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 131/273] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:30:51 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:30:51.992411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6c35854b-3132-4e20-a32b-124dc970bad9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 18083 microversion: 2.1 time: 0.166228 Sep 02 04:30:51.993179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 143/274] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:51 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 18083 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:52.002266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-79faac3c-2a3b-45ad-a353-a3656a749c91 req-4f408dde-f4da-4122-bf78-d36ea9217c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b6490-8575-4988-a3e4-16835e3960ab", "name": "network-vif-deleted", "tag": "077d2e89-136e-4129-8828-d2366fff9d58"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:52.003888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:30:52.003888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:30:52.012427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-79faac3c-2a3b-45ad-a353-a3656a749c91 req-4f408dde-f4da-4122-bf78-d36ea9217c70 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.012956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-79faac3c-2a3b-45ad-a353-a3656a749c91 req-4f408dde-f4da-4122-bf78-d36ea9217c70 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.025380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-79faac3c-2a3b-45ad-a353-a3656a749c91 req-4f408dde-f4da-4122-bf78-d36ea9217c70 service nova] Creating event network-vif-deleted:077d2e89-136e-4129-8828-d2366fff9d58 for instance 843b6490-8575-4988-a3e4-16835e3960ab on hv-cinder-80473 Sep 02 04:30:52.033098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-79faac3c-2a3b-45ad-a353-a3656a749c91 req-4f408dde-f4da-4122-bf78-d36ea9217c70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036108 Sep 02 04:30:52.034242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 132/275] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:30:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:52.170823 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:52.171407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.177753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.178194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.178947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.179379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.192080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] HTTP exception thrown: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. Sep 02 04:30:52.192658 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Returning 404 to user: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:52.193445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-121ce5fc-dec4-491f-8d8d-211d3692de94 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 404 len: 111 microversion: 2.1 time: 0.026607 Sep 02 04:30:52.193951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 144/276] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:30:52 2021] DELETE /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:30:52.202156 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:52.202846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] [instance: 9a7102e2-bb80-4a08-8689-fe3c5678fb83] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.209295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.209740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.210484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.210911 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.224564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] HTTP exception thrown: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. Sep 02 04:30:52.225218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] Returning 404 to user: Instance 9a7102e2-bb80-4a08-8689-fe3c5678fb83 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:52.234749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-54ec33eb-c73a-4683-aa23-688603ee1ef4 tempest-DeleteServersTestJSON-446595371 tempest-DeleteServersTestJSON-446595371-project] 10.222.0.13 "GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83" status: 404 len: 111 microversion: 2.1 time: 0.028011 Sep 02 04:30:52.238797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 133/277] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:52 2021] GET /compute/v2.1/servers/9a7102e2-bb80-4a08-8689-fe3c5678fb83 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:30:52.413571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:52.414375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.420662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.432334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.432334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.432334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.551573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:52.558924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cc9bd5c6-4886-4266-958a-867ef1e84465 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.149162 Sep 02 04:30:52.559477 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 145/278] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:52 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:52.761787 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:52.762741 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.769515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.769955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.770706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.771133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.907441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-58d0d42e-fa49-4676-88ae-10bf663735b4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 20062 microversion: 2.20 time: 0.149240 Sep 02 04:30:52.908123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 134/279] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:52 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 20062 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:52.920140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:52.920970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.926990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.927435 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.928231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.928671 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.959375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.959821 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.960314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lazy-loading 'fault' on Instance uuid 843b6490-8575-4988-a3e4-16835e3960ab {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:30:52.966933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:52.968657 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:52.979595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.980638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:52.982436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:52.983028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.029300 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1f0c46b5-b6e9-449c-bde0-378c86146b34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066856 Sep 02 04:30:53.030206 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 135/280] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:30:52 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:30:53.035088 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:53.036060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:53.041851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.042299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.043059 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.043644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.048921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b16503f535744379ac1bad7e13f6826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30f982efcf34666bc009a926ca5fa78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:53.060935 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0ad7ae69-2c15-4f28-915b-598139409ea9 tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 200 len: 1305 microversion: 2.1 time: 0.141732 Sep 02 04:30:53.060935 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 146/281] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:52 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:53.148981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-229436bb-b341-429f-a7bd-270a39e925af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 19342 microversion: 2.1 time: 0.117286 Sep 02 04:30:53.149369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 136/282] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:53 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 19342 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:53.575272 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:53.575880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:53.582920 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.583374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.584172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.584602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.716456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:53.724394 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0bb74854-c0a4-46bf-958d-516b27bc2ebc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.152675 Sep 02 04:30:53.724959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 147/283] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:53 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:53.924139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:53.925260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:53.943421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.943978 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:53.944897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:53.945472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.041645 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:54.042576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:54.048327 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.048764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.049504 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.049928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.086498 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-36f431d5-6f25-4f12-a464-1f181cb9cfc9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048551 Sep 02 04:30:54.087100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 148/284] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:30:54 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:30:54.096590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:54.097213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] [instance: 843b6490-8575-4988-a3e4-16835e3960ab] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:54.104647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.105097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.105872 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.106302 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.119867 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0060566d-7d07-462c-8a2b-5f7136649d62 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 21709 microversion: 2.20 time: 0.199717 Sep 02 04:30:54.120537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 137/285] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:53 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 21709 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:54.124493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] HTTP exception thrown: Instance 843b6490-8575-4988-a3e4-16835e3960ab could not be found. Sep 02 04:30:54.125877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] Returning 404 to user: Instance 843b6490-8575-4988-a3e4-16835e3960ab could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:30:54.126778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a7b60109-3603-4296-ab51-88164a1a6b8b tempest-VolumesNegativeTest-713639432 tempest-VolumesNegativeTest-713639432-project] 10.222.0.13 "GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab" status: 404 len: 111 microversion: 2.1 time: 0.038755 Sep 02 04:30:54.127390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 149/286] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:54 2021] GET /compute/v2.1/servers/843b6490-8575-4988-a3e4-16835e3960ab => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:30:54.180178 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:54.186889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:54.201214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.203515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.207780 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.208413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.329132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2082074733", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "26ff5384-f842-4306-a318-71b587753ace"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:54.371313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-90faed79-ed56-48b1-886b-261c8ef497e2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 21288 microversion: 2.1 time: 0.212030 Sep 02 04:30:54.372575 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 138/287] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:54 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 21288 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:54.525851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] validate_networks() for [('26ff5384-f842-4306-a318-71b587753ace', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:30:54.742449 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:54.743271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:54.750739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.751257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.752132 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.752629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.805687 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:30:54.806688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:30:54.807324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:30:54.817183 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:30:54.818152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:30:54.833231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.833931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.834752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:54.835315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:54.855401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:30:54.859853 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for user c05601393e5948458fd6e350520776c5 and project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:30:54.878233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:30:54.881969 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:30:54.890672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:54.899365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-45275955-2df6-41bc-9b2e-1eef692438dd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.160974 Sep 02 04:30:54.910684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 139/288] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:54 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:55.068751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7a15bc70-868b-495d-9d4e-cebcb4d83de0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743520 Sep 02 04:30:55.069889 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 150/289] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:30:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:30:55.079333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f1543408-9465-492f-beca-be37fa56cc6f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:55.080890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f1543408-9465-492f-beca-be37fa56cc6f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:55.132221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:55.133361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:55.142552 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f1543408-9465-492f-beca-be37fa56cc6f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:55.143281 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.144384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:55.149592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.149592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:55.157016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f1543408-9465-492f-beca-be37fa56cc6f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1218 microversion: 2.1 time: 0.080816 Sep 02 04:30:55.158189 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 140/290] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:55 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:55.283147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4fe1cf68-4519-4c1a-ab60-dc00b56429b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 22974 microversion: 2.20 time: 0.154615 Sep 02 04:30:55.286321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 151/291] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:55 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 22974 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:30:55.382783 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:55.383726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:55.390572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.391013 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:55.392366 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.392662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:55.518828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a263b257-dd6d-468e-adca-7b44d8b060bc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 22716 microversion: 2.1 time: 0.139656 Sep 02 04:30:55.520070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 141/292] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:55 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 22716 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:55.916896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:55.917592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:55.924482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.924933 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:55.925704 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:55.926138 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.059043 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:56.066724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c34c650b-8bb4-4d51-85ea-819bd5e406bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.153863 Sep 02 04:30:56.067414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 152/293] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:55 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:56.175726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:56.176681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:56.187828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.188821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.190057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.191369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.276299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:56.284480 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eb4b0ee6-f5c3-4f0a-bb84-7edb4aae3228 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1222 microversion: 2.1 time: 0.113455 Sep 02 04:30:56.295704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 142/294] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:56 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:56.300744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:56.303814 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:56.307728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.308148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.308916 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.309344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.431375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-00fb9cff-5f11-4df5-a128-6a96aa6bd9dc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 23796 microversion: 2.20 time: 0.134601 Sep 02 04:30:56.434560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 153/295] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:56 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 23796 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:56.532214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:56.533298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:56.539236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.539648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.540646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:56.541086 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:56.677034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9339f710-718c-4927-acf1-649e25c9bca0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 23804 microversion: 2.1 time: 0.147820 Sep 02 04:30:56.677708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 143/296] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:56 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 23804 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:57.084137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:57.084838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:57.091330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.091796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.092626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.093070 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.222936 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:57.230723 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-986c2ee7-098e-4fc3-91af-a41bc5691dc2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.150680 Sep 02 04:30:57.231533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 154/297] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:57 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:57.302879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:57.303579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:57.309950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.310397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.311158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.311779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.380294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:57.388960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c5928d86-398b-402d-96ea-5bda1172cb2a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1270 microversion: 2.1 time: 0.090040 Sep 02 04:30:57.389494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 144/298] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:57 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:57.444795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:57.445706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:57.453529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.455802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.457017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.457516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.588150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8dec046c-b508-4fc0-8e70-9d2d77a63acf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 24687 microversion: 2.20 time: 0.147271 Sep 02 04:30:57.588784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 155/299] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:57 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 24687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:30:57.689269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:57.690222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:57.696387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.696837 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.697602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:57.698082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:57.831964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8b1ed51a-1e70-4394-a195-dd8c0d9f12da tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 24688 microversion: 2.1 time: 0.146884 Sep 02 04:30:57.833384 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 145/300] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:57 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 24688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:30:58.251766 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:58.254449 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:58.273818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.274261 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.288297 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.288754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.408857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:58.416259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:58.427397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.429676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.432303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.433974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.558950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:58.575108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aa2662a4-ee0c-4e57-8d0f-12b0617d5f9d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.330975 Sep 02 04:30:58.576397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 156/301] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:58 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:58.599841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:58.601262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:58.610864 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.612524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.615233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.620402 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.673118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:58.686591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-04e15bfd-0c23-4ef9-ba7d-825ff9ea8382 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1276 microversion: 2.1 time: 0.282379 Sep 02 04:30:58.689536 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 146/302] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:58 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:58.752960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1ef5f58c-b416-4c85-bb1a-d8ada01c1d4b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 25731 microversion: 2.20 time: 0.157401 Sep 02 04:30:58.754206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 157/303] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:58 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 25731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:30:58.845025 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:58.846130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:58.854571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.855021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.855796 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:58.856269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:58.985991 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-66ef5a42-52cc-4876-97ad-c06f657c9d95 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 25726 microversion: 2.1 time: 0.142200 Sep 02 04:30:58.989760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 147/304] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:58 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 25726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:30:59.594558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:59.595269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:59.602993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.603665 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.604472 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.604911 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.707678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:30:59.708412 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:59.719060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.719524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.729177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.729177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.810113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:30:59.824491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-75c5afd1-3ba6-4070-8070-0eb5064776e0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.235193 Sep 02 04:30:59.825843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 158/305] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:59 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:30:59.834138 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:30:59.838394 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:30:59.845870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.846398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.847260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:30:59.848277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:30:59.979189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-434f2042-2e5d-40ae-b272-1c95160f66b3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 26369 microversion: 2.20 time: 0.148129 Sep 02 04:30:59.980833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 159/306] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:30:59 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 26369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:00.000745 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:00.003244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:00.013015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:00.014738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:00.016921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:00.017614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:00.061297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:00.073193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a65fa3ca-860c-4ff0-a019-1e6f431cb472 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.370308 Sep 02 04:31:00.073873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 148/307] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:30:59 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:00.172183 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b0150ffe-a716-415a-afbb-059b8f9435bf tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 26487 microversion: 2.1 time: 0.177411 Sep 02 04:31:00.177338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-127a2a36-93c3-4a9f-880c-3ae08f8c0dc2 req-389e27fc-79d5-4c12-bd30-a523812ca7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad777a2-0af2-4029-b809-76f5a1e1ca17", "tag": "7fab62ca-8e68-4404-bd59-4dcece51f30a"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:00.192276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 160/308] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:30:59 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 26487 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:00.192565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:31:00.192565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:31:00.192565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-127a2a36-93c3-4a9f-880c-3ae08f8c0dc2 req-389e27fc-79d5-4c12-bd30-a523812ca7b3 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:00.192565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-127a2a36-93c3-4a9f-880c-3ae08f8c0dc2 req-389e27fc-79d5-4c12-bd30-a523812ca7b3 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:00.200897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-127a2a36-93c3-4a9f-880c-3ae08f8c0dc2 req-389e27fc-79d5-4c12-bd30-a523812ca7b3 service nova] Creating event network-changed:7fab62ca-8e68-4404-bd59-4dcece51f30a for instance 6ad777a2-0af2-4029-b809-76f5a1e1ca17 on hv-cinder-80473 Sep 02 04:31:00.209343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-127a2a36-93c3-4a9f-880c-3ae08f8c0dc2 req-389e27fc-79d5-4c12-bd30-a523812ca7b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038269 Sep 02 04:31:00.210205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 149/309] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:31:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:31:00.849110 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:00.849890 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:00.863772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:00.864419 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:00.865406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:00.866416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:00.990308 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:00.991862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:01.004970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.005682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.006653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.007289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.082480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:01.095608 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2e19a28e-f817-49c2-be16-1acb45d7f8bf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.253583 Sep 02 04:31:01.097102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 161/310] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:00 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:01.104165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:01.105012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:01.114569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.115208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.116390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.117024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.148169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a17ba2ad-136d-4c52-bcf0-27c06e74f654 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 27030 microversion: 2.20 time: 0.162155 Sep 02 04:31:01.149311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 150/311] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:00 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 27030 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:01.185333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:01.186610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:01.194253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.194699 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.195487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:01.196335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:01.261589 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:01.270959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-04887e4f-7fa2-4418-b014-b8370321ba30 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.172553 Sep 02 04:31:01.271631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 162/312] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:01 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:01.346864 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7fecb866-dd9c-43c3-a4eb-05ac69ce0c1c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 27106 microversion: 2.1 time: 0.163775 Sep 02 04:31:01.347799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 151/313] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:01 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 27106 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:02.115115 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:02.115733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:02.128943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.129291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.130298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.130798 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.165973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:02.169537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:02.181522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.182239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.183109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.183547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.331929 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1ed9dc72-1bc3-4cdc-baa9-c0a1a2ff0891 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 27473 microversion: 2.20 time: 0.171016 Sep 02 04:31:02.339358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 152/314] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:02 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 27473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:02.339358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:02.339358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:02.348098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.348536 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.349449 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.350026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.384530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:02.394423 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f8e85898-276f-45c6-8fc6-68cdd723e001 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.285039 Sep 02 04:31:02.395103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 163/315] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:02 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:02.411340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:02.412296 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:02.418466 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.419277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.420099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:02.420543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:02.511184 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:02.519971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-804d28ad-3fe3-4210-bb58-287b4a3cedf0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.186256 Sep 02 04:31:02.520530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 153/316] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:02 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:02.548782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5140547a-8046-472f-b8ba-3fb7345c702d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 27564 microversion: 2.1 time: 0.143504 Sep 02 04:31:02.549420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 164/317] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:02 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 27564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:03.349602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:03.354270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:03.372693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.373179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.375434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.376398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.411827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:03.412557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:03.423495 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.423993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.426139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.426575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.501736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5f22a8a3-51d3-4607-b5df-83aafac81c28 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 27724 microversion: 2.20 time: 0.158462 Sep 02 04:31:03.507193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 154/318] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:03 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 27724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:03.543035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:03.543740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:03.555682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.556164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.557063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.557499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.573586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:03.584204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9607fccb-cd59-444e-b5a6-1fa8a6b5eec8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.176546 Sep 02 04:31:03.584994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 165/319] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:03 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:03.590066 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:03.591177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:03.598293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.598821 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.599546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:03.600005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:03.708616 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:03.717323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fedc04c8-c2a8-4cd4-bfed-50f6fddd6771 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.182208 Sep 02 04:31:03.719521 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 155/320] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:03 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:03.720741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a90c0d46-35ab-4819-b915-6284504a92d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 27860 microversion: 2.1 time: 0.134182 Sep 02 04:31:03.721560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 166/321] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:03 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 27860 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:04.518016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:04.518016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:04.522407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.522924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.523701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.524159 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.603196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:04.603923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:04.612451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.612895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.613696 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.614143 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.646104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5f5887ce-3be5-4dcc-ba91-798ffaf696e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 27936 microversion: 2.20 time: 0.136226 Sep 02 04:31:04.648530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 156/322] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:04 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 27936 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:04.733515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:04.734725 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:04.746029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.746029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.746029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.746029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.771632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:04.783188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7bfbbf43-7feb-415e-bf7e-5129624b34ed tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.185552 Sep 02 04:31:04.785446 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 167/323] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:04 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:04.789813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:04.790422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:04.797674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.797674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.798411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:04.799025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:04.888659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dcdecc63-198d-4ba0-bac2-15ba5abc4447 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28168 microversion: 2.1 time: 0.158136 Sep 02 04:31:04.889355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 157/324] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:04 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:04.935189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:04.948416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5aa2c69a-fabd-40f0-a676-665a561fc2fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.161877 Sep 02 04:31:04.957536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 168/325] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:04 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:05.661364 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:05.667595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:05.676427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:05.678292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:05.679547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:05.680023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:05.800600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:05.801774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:05.812748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:05.813776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:05.816019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:05.816019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:05.993745 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:05.997571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b23d5ec1-15fa-46c9-942c-85453591a1c5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.201596 Sep 02 04:31:05.998140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 169/326] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:05 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:06.005357 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:06.006934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:06.022802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:06.024501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:06.026248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:06.026844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:06.159142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-516e27a2-8d33-4474-9ed9-63881eec421a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28146 microversion: 2.20 time: 0.504264 Sep 02 04:31:06.160193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 158/327] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:05 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28146 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:06.170445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:06.171854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:06.178838 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:06.179295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:06.180142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:06.180878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:06.217700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-77c536f9-87db-45ba-b2ba-a0b738e660c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28168 microversion: 2.1 time: 0.216649 Sep 02 04:31:06.219282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 170/328] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:05 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28168 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:06.646437 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:06.657224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9b6532e4-fbad-4913-87fa-606371efd31c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.495660 Sep 02 04:31:06.657804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 159/329] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:06 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:07.017271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:07.018761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:07.038256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.038706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.044403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.044776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.174772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:07.175797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:07.190577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.191399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.192441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.193356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.297467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:07.308714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-12e10805-1e8c-4d33-b379-321010892a23 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1522 microversion: 2.1 time: 0.296438 Sep 02 04:31:07.309820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 171/330] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:07 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:07.320687 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:07.322078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:07.332010 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.340490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-66491b21-8a05-4948-89b7-da86df0cb2ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28146 microversion: 2.20 time: 0.170903 Sep 02 04:31:07.342859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 160/331] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:07 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28146 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:07.342946 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.343319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.343790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.464943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4e17b309-7a27-490e-a5d2-504056c3fdd5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28168 microversion: 2.1 time: 0.153397 Sep 02 04:31:07.465988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 172/332] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:07 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:07.677409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:07.678116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:07.685772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.689518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.689518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:07.689518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:07.938229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:07.958382 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6836b551-727a-4264-96d4-7487459d3fe7 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.287607 Sep 02 04:31:07.975738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 161/333] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:07 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:08.326510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:08.327282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:08.336910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:08.337540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:08.338493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:08.339085 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:08.353448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:08.354610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:08.366289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:08.368786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:08.369805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:08.370460 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:09.058346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:09.105157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-47b3785d-7b45-4c51-a5b3-406edbe49a5a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1502 microversion: 2.1 time: 0.782572 Sep 02 04:31:09.111071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 173/334] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:08 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1502 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:09.118408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:09.118408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:09.123776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:09.124559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:09.125572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:09.126210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.315883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e553c682-1e08-4e99-8b16-c9918b336594 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28146 microversion: 2.20 time: 1.966702 Sep 02 04:31:10.320207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 162/335] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:08 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28146 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:10.322272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:10.322999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:10.329455 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:10.330097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.331023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:10.331479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.348391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-47949d5a-4e05-4008-8a7d-993cd8fbc53e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28168 microversion: 2.1 time: 1.234351 Sep 02 04:31:10.356690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 174/336] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:09 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28168 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:10.362693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:10.363311 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:10.378216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:10.379824 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.380626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:10.381060 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.565759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:10.575264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2765745b-1498-47c8-9072-8c0152b6c864 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1515 microversion: 2.1 time: 0.216974 Sep 02 04:31:10.576481 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 175/337] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:10 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:10.581952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-0db92643-ca56-48d3-9f09-9076d524b9d9 req-c96e794f-6102-4a44-9049-b89aa34aa95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad777a2-0af2-4029-b809-76f5a1e1ca17", "name": "network-vif-plugged", "status": "completed", "tag": "7fab62ca-8e68-4404-bd59-4dcece51f30a"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:10.584329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:31:10.584329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:31:10.591667 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:10.595120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-0db92643-ca56-48d3-9f09-9076d524b9d9 req-c96e794f-6102-4a44-9049-b89aa34aa95d service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:10.595120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-0db92643-ca56-48d3-9f09-9076d524b9d9 req-c96e794f-6102-4a44-9049-b89aa34aa95d service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:10.600135 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b1bb4547-d6c4-4171-9494-09be407a5596 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.281762 Sep 02 04:31:10.604066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 163/338] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:10 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:10.609482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-0db92643-ca56-48d3-9f09-9076d524b9d9 req-c96e794f-6102-4a44-9049-b89aa34aa95d service nova] Creating event network-vif-plugged:7fab62ca-8e68-4404-bd59-4dcece51f30a for instance 6ad777a2-0af2-4029-b809-76f5a1e1ca17 on hv-cinder-80473 Sep 02 04:31:10.615635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-0db92643-ca56-48d3-9f09-9076d524b9d9 req-c96e794f-6102-4a44-9049-b89aa34aa95d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037561 Sep 02 04:31:10.624084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 176/339] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:11.335140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:11.337727 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:11.365277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:11.366377 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:11.377872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.378165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.378975 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.379397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.384828 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.385470 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.386389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.386826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.740157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b240bf2f-2b0b-4546-81dd-35500c0a9f71 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28458 microversion: 2.1 time: 0.380800 Sep 02 04:31:11.744088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 177/340] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:11 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28458 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:11.755086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:11.756108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:11.767365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.767831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.773266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:11.774670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-18edb0a4-1b32-4f0b-b7fa-7235e9a19de6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28437 microversion: 2.20 time: 0.449345 Sep 02 04:31:11.775118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:11.776385 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 164/341] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:11 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28437 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:11.957179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:11.966157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-01c135ee-0682-4247-8c3d-f63b86544b68 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.218872 Sep 02 04:31:11.966157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 178/342] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:11 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:12.572398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:12.574144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:12.586410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.586410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:12.586410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.586754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:12.625517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lazy-loading 'flavor' on Instance uuid 3ffde743-fe81-4cab-9344-57ca521c59f4 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:31:12.752583 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:12.754446 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:12.759702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.760202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:12.760977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.761371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:12.923108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c2565aea-5d54-4319-ab01-6b1b51e11c7c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28581 microversion: 2.1 time: 0.175321 Sep 02 04:31:12.923755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 179/343] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:12 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28581 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:12.930174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:12.931414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:12.943057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.943514 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:12.944373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:12.945988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.072815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-32d078a2-42ba-410c-814f-ff4c6fab22be tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28533 microversion: 2.20 time: 0.147321 Sep 02 04:31:13.073475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 180/344] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:12 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28533 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:13.079614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:13.080384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:13.092418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-53d17a2f-0d52-4df0-b86b-98c7bd45c491 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action" status: 200 len: 32 microversion: 2.1 time: 0.522480 Sep 02 04:31:13.095492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 165/345] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:12 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action => generated 32 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:31:13.105668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:13.107413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.107665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:13.107947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.110454 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.110956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.115413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.115849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.116823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.117256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.312620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:13.320683 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:13.323981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-31c42022-812f-4e10-9df7-a726b18ad61c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.221466 Sep 02 04:31:13.324996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 166/346] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:13 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:13.336418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e2fe839b-6bee-493c-9036-cc7b36bbc24d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1318 microversion: 2.1 time: 0.261438 Sep 02 04:31:13.343086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 181/347] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:13 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:13.945323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:13.947678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:13.957341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.957880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:13.958886 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:13.959496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.085410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-795d43f6-b1ad-4971-8537-fca036b18b2e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28623 microversion: 2.1 time: 0.145129 Sep 02 04:31:14.086050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 167/348] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:13 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28623 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:14.088194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:14.090300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:14.103840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.104320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.105098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.105573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.254106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-304ca88a-ae1b-4ed5-b2f1-3ec714bc8fad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28605 microversion: 2.20 time: 0.169878 Sep 02 04:31:14.258117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 182/349] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:14 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:14.343396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:14.344444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:14.361736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.362243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.364822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.365317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.368018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:14.370561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:14.391797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.393563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.400404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:14.401168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:14.587398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:14.589904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:14.595705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-773bc39f-d9a4-490c-964f-7b3da40d323a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1507 microversion: 2.1 time: 0.233825 Sep 02 04:31:14.596358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 183/350] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:14 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:14.599525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c424a680-522d-4453-b8a6-ce9ed8b41525 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.260696 Sep 02 04:31:14.604712 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 168/351] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:14 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:15.099783 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:15.104213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:15.110720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.112533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.113748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.113872 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.231350 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-41c17840-318c-4ee9-8220-97b986a44d59 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28623 microversion: 2.1 time: 0.135449 Sep 02 04:31:15.232795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 184/352] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:15 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28623 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:15.265763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:15.267430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:15.273939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.274441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.278597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.278597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.391138 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cdbd3081-dba2-4c49-b9b6-cd448c219afb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28605 microversion: 2.20 time: 0.127645 Sep 02 04:31:15.397291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 169/353] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:15 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:15.618696 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:15.620212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:15.637780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.641418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.642598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:15.643164 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:15.922385 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:15.931148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4d03c18f-bec3-445c-a892-7174265ae6af tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.317252 Sep 02 04:31:15.931925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 185/354] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:15 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:16.244217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:16.261672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:16.265736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.266180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.266961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.267389 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.402682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:16.403708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:16.410370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.410949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.411790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.412422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.415411 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bc2a158b-f17d-4280-bb0e-6f830791ec1a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28623 microversion: 2.1 time: 0.175164 Sep 02 04:31:16.416097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 170/355] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:16 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28623 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:16.519823 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-457e96f7-f287-4bda-b36b-0e5917e4d8f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28605 microversion: 2.20 time: 0.120658 Sep 02 04:31:16.520985 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 186/356] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:16 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:16.586482 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90328aa5-ba53-4649-a2e5-81c0cb54bae0"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:16.588042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:16.597112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.597557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.598789 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.599412 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.949202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:16.949921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:16.958917 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.959386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:16.960196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:16.960630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:17.181589 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:17.191925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-53a28fcf-78ef-427d-bbe4-712fa66b24d2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.245652 Sep 02 04:31:17.191925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 187/357] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:16 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:17.427135 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:17.428310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:17.437035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:17.437850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:17.440241 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:17.441159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:17.560754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8c90d9e0-d98f-4a02-b7c1-b655e16ff3c5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28623 microversion: 2.1 time: 0.137144 Sep 02 04:31:17.561395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 188/358] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:17 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28623 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:17.570908 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:17.571956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:17.579079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:17.579631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:17.580304 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:17.580928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:17.688246 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e3cd205-1255-4727-a26c-e40c3494f7fd tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28605 microversion: 2.20 time: 0.125323 Sep 02 04:31:17.693431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 189/359] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:17 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:17.888287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ac225b14-829a-4bfb-80cc-c6f1da6fc84e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308647 Sep 02 04:31:17.905139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 171/360] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:31:16 2021] POST /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:18.219017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:18.219017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:18.224402 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.225219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.226879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.227324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.412157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:18.422147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-40d56801-6fa4-460a-bd83-2bd043f91741 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.211699 Sep 02 04:31:18.432008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 190/361] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:18 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:18.573893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:18.575138 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:18.581550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.582472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.583393 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.584017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.697825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-62af5d23-8892-47d8-a229-f24f57da2023 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 28623 microversion: 2.1 time: 0.128517 Sep 02 04:31:18.700735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:18.701875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:18.702467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 172/362] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:18 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 28623 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:18.708300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.708744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.709684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:18.710272 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:18.836141 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ab4f5a57-bf6c-412f-91a9-4cbc6bf92794 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 28605 microversion: 2.20 time: 0.139555 Sep 02 04:31:18.837011 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 191/363] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:18 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 28605 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:19.439599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:19.440428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:19.450224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.450605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.451401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.451859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.663770 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:19.674209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e283caf9-4e54-491c-904d-6299b711d68e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.239283 Sep 02 04:31:19.674778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 173/364] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:19 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:19.712827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:19.714368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:19.721021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.721566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.722815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.724198 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.848507 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:19.849957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:19.857620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.862931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.862931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:19.862931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:19.885041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e06185e4-92a8-405a-bc80-30cb9abb666a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 29719 microversion: 2.1 time: 0.178065 Sep 02 04:31:19.886349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 192/365] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:19 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 29719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:19.994773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dd882b7a-da80-4858-9f8b-467e791649d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 29851 microversion: 2.20 time: 0.150235 Sep 02 04:31:19.995577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 174/366] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:19 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 29851 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:20.691795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:20.692558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:20.699151 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:20.699596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:20.700374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:20.700847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:20.832454 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:20.839830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ae851dca-1fe4-478a-95b6-738332df1bc8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.152071 Sep 02 04:31:20.840418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 193/367] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:20 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:20.897210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:20.898227 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:20.904646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:20.905090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:20.906458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:20.906891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:21.006562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:21.007493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:21.013310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:21.013758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:21.014627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:21.014976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:23.789785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cec8e10a-4207-4b42-8649-bda2f93188f7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 32786 microversion: 2.1 time: 2.886124 Sep 02 04:31:23.789785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 175/368] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:20 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 32786 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:23.789785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:23.789785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:23.796598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:23.797491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:23.798493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:23.799143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:23.809749 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7c23a164-1969-4cb2-98cf-f1e8534469f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 35791 microversion: 2.20 time: 2.806753 Sep 02 04:31:23.810808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 194/369] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:21 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 35791 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:23.974904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:23.987170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c7dbd3d9-3616-4a3d-a74e-29eeb40fbcb4 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.203704 Sep 02 04:31:23.988125 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 176/370] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:23 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:24.792560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:24.793911 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:24.800676 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:24.801124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:24.801888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:24.802316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:24.828675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:24.830242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:24.844041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:24.844041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:24.844041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:24.844041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:24.999691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5f27ffe8-77a8-4d7f-9009-69ddf1de10d0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 36376 microversion: 2.20 time: 0.174777 Sep 02 04:31:25.001670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 177/371] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:24 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 36376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:25.007425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:25.010330 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:25.018496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:25.019236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:25.020208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:25.020799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:25.034139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f45c0b1e-60ef-4085-8be7-a811aa57fb6c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 33289 microversion: 2.1 time: 0.245527 Sep 02 04:31:25.038962 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 195/372] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:24 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 33289 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:25.168878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:25.176750 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5d9cf195-3e49-4e69-bbe8-2e5f1eddebd1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.173577 Sep 02 04:31:25.181105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 178/373] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:25 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:26.012966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:26.014097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:26.026143 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:26.028220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:26.029427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:26.029427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:26.045989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:26.047570 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:26.059254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:26.060298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:26.060458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:26.065216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:28.544219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e67f9acf-0fea-40fe-85cf-2a8a3439f8fc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 37678 microversion: 2.20 time: 2.535082 Sep 02 04:31:28.548849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 196/374] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:26 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 37678 bytes in 2538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:28.550625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:28.551326 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:28.557611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:28.558055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:28.558999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:28.559613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:28.587025 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a873c225-8029-412e-b8eb-a5a22a350871 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 35719 microversion: 2.1 time: 2.544644 Sep 02 04:31:28.588070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 179/375] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:26 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 35719 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:28.694321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:28.702876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a6af19ba-5619-474d-8383-66f094abe600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.155447 Sep 02 04:31:28.703444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 197/376] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:28 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:29.560253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:29.561246 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:29.568531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:29.568969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:29.569724 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:29.570145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:29.600590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:29.602437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:29.609614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:29.610169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:29.611164 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:29.611694 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:31.961048 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-937d226e-f79b-4f23-8bfa-dcd35333ed04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 37962 microversion: 2.20 time: 2.404737 Sep 02 04:31:31.965304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 180/377] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:29 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 37962 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:31.967493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:31.968923 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:31.975809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:31.976548 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:31.977314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:31.977738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:31.988244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3fc1aad3-e7f0-4b0b-971e-6fc674c54df9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 38098 microversion: 2.1 time: 2.391275 Sep 02 04:31:31.990010 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 198/378] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:29 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 38098 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:31:32.098683 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:32.106334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c37d0300-60cb-4dfc-aed4-ea8858558a90 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.143102 Sep 02 04:31:32.106907 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 181/379] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:31 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:32.148045 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'create', calling method: .version_select at 0x7fa04bcbba60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-779197721"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:32.169302 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:31:32.173066 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for user abeea085a0024fc98d88cf91ce800749 and project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:31:32.583842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:31:32.587674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for user abeea085a0024fc98d88cf91ce800749 and project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:31:32.600664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f5e6bde0-8ee5-48b6-8667-ffd4b93d0133 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.463924 Sep 02 04:31:32.601520 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 199/380] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Sep 2 04:31:32 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:32.649660 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-759518574", "imageRef": "a01bf7e3-032f-4d82-a0b3-2feb6762522e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-779197721", "networks": [{"uuid": "033cbb20-1bf0-4986-a01b-c8f4d3477953"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:32.698118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] validate_networks() for [('033cbb20-1bf0-4986-a01b-c8f4d3477953', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:31:32.973443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:32.974608 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:32.980990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:32.981515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:32.982347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:32.982879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.065649 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:31:33.066123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:31:33.066641 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:31:33.067042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:31:33.067443 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:31:33.077172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.077613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.078395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.078818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.095828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:31:33.099753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Getting quotas for user abeea085a0024fc98d88cf91ce800749 and project 13dd2e352f6149d4beb1d4f84664a614. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:31:33.112315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:31:33.114471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eab6eacd-0eeb-4e73-849a-5d1115245f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 38029 microversion: 2.20 time: 0.144622 Sep 02 04:31:33.114932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a01bf7e3-032f-4d82-a0b3-2feb6762522e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:31:33.115970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 200/381] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:32 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 38029 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:33.129803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:33.129803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.131692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.132298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.133215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.133740 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.242358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7320367a-d81d-415b-8249-72c74cbf8991 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 38098 microversion: 2.1 time: 0.124504 Sep 02 04:31:33.243003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 201/382] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:33 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 38098 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:33.247827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:33.248585 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.251373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3ebc4312-42c5-4095-86bd-bc1424150d1d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605634 Sep 02 04:31:33.252091 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 182/383] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:31:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:31:33.256730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90328aa5-ba53-4649-a2e5-81c0cb54bae0"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:33.258070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.260726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.261231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.262274 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.262710 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.264249 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.266365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.267144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.267665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.359650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Invalid volume: volume 90328aa5-ba53-4649-a2e5-81c0cb54bae0 is already attached to instances: 6ad777a2-0af2-4029-b809-76f5a1e1ca17 Sep 02 04:31:33.360329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 400 to user: Invalid volume: volume 90328aa5-ba53-4649-a2e5-81c0cb54bae0 is already attached to instances: 6ad777a2-0af2-4029-b809-76f5a1e1ca17 {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:31:33.361163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-449887bd-a867-4529-bb91-9f6b7c27e808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108013 Sep 02 04:31:33.361733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 183/384] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:31:33 2021] POST /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:31:33.366977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e484445c-f0ca-4e6f-a628-66da5a6eef4e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:33.367822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e484445c-f0ca-4e6f-a628-66da5a6eef4e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.455157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:33.456092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e484445c-f0ca-4e6f-a628-66da5a6eef4e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:33.462681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d37573b1-f5a4-42ba-a458-18fd60de37c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.218575 Sep 02 04:31:33.463109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e484445c-f0ca-4e6f-a628-66da5a6eef4e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1257 microversion: 2.1 time: 0.100103 Sep 02 04:31:33.463404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 202/385] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:33 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:33.463987 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 184/386] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:33 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1257 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:33.471795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:33.473067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.479641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.480267 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.481113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.481626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.567992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'services' on Instance uuid 6ad777a2-0af2-4029-b809-76f5a1e1ca17 {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:31:33.824312 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0049c55e-d68b-40b8-85c0-28cb2965b7d2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments/90328aa5-ba53-4649-a2e5-81c0cb54bae0" status: 202 len: 0 microversion: 2.1 time: 0.356211 Sep 02 04:31:33.824312 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 203/387] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:31:33 2021] DELETE /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments/90328aa5-ba53-4649-a2e5-81c0cb54bae0 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:33.831929 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:33.833004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:33.839123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.839980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.840823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:33.841333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:33.871183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-23dc2df4-1fa5-483b-9809-31891d41f4e2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Sep 02 04:31:33.871747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 185/388] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:31:33 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:34.127583 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:34.128774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.134936 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.135387 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.136169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.136593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.241013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-504ccfe1-e267-4417-b590-676d89ca0985 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 38029 microversion: 2.20 time: 0.117805 Sep 02 04:31:34.241769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 204/389] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:34 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 38029 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:34.255031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:34.255962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.261805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.262244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.262989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.263412 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.383983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-12162a66-7c51-4612-928a-bd7aeed54bfb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 200 len: 38227 microversion: 2.1 time: 0.132476 Sep 02 04:31:34.384730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 186/390] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:34 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 38227 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:34.395674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:34.396260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.402733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.403179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.403966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.404408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.430273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e65a7fb0-fe93-4e68-96cd-a4c8fb4f2ec9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/ips" status: 200 len: 144 microversion: 2.1 time: 0.039395 Sep 02 04:31:34.430820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 205/391] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:31:34 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:34.481064 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:34.481976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.495116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.495116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.495116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.495116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.520205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:34.520903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.527642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.528181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.528942 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.529457 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.551570 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:34.559494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b499e735-32da-47ec-ba6e-0fdf9b4dec99 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1261 microversion: 2.1 time: 0.082368 Sep 02 04:31:34.560444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 187/392] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:34 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:34.670345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:34.677698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ab0010bb-66ed-4135-963b-d80a9b5c59ca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.161897 Sep 02 04:31:34.681792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 206/393] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:34 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:34.883141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:34.884117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:34.889853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.890291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.891041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:34.891472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:34.925414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-37d14588-7857-41ae-864d-359cd4ee4f8c tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Sep 02 04:31:34.925909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 188/394] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:31:34 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:35.253270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:35.254181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:35.260011 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.260459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.261222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.261760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.369836 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ea1aabfb-cb0d-4b6f-82f2-8baf805cf2a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 200 len: 38169 microversion: 2.20 time: 0.120577 Sep 02 04:31:35.370767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 207/395] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:35 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 38169 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:31:35.381007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:35.381498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:35.387441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.387893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.388686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.389120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.411793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0e9efa6b-2359-45db-8ec3-a264b28d9e97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/ips" status: 200 len: 153 microversion: 2.20 time: 0.034546 Sep 02 04:31:35.412375 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 189/396] 10.222.0.13 () {60 vars in 1289 bytes} [Thu Sep 2 04:31:35 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:31:35.576493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:35.577248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:35.583792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.588672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.588672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.588672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.644956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:35.652075 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7232f9de-9b08-4cf7-b748-ae1d11a3f966 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1309 microversion: 2.1 time: 0.079556 Sep 02 04:31:35.652632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 208/397] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:35 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1309 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:35.694894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:35.695680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:35.703445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.703445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.703693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.703973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.822034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:35.831370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3aa2c89e-f217-454d-925d-52d0970efac7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.140060 Sep 02 04:31:35.831990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 190/398] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:35 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:35.936031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:35.936943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:35.942637 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.943086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.943847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:35.944315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:35.978258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-318afbfc-92c8-487f-83fc-1c5fd6670156 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 Sep 02 04:31:35.978258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 209/399] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:31:35 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:36.677797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:36.678421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:36.687674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.688638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:36.689408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.690030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:36.757342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:36.764778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-add8f54f-933a-4b5d-ad5f-218cc8bf5bc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1315 microversion: 2.1 time: 0.096991 Sep 02 04:31:36.765343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 191/400] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:36 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1315 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:36.849021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:36.849706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:36.857465 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.858250 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:36.859212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.859649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:36.985697 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:36.986580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:36.994789 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.995237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:36.996042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:36.996478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:37.033362 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:37.041279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-36780fa0-e774-47eb-8b35-cea36a7e355c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.196753 Sep 02 04:31:37.043981 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 210/401] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:36 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:37.080241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4c59f1c5-c288-4046-8162-1ccab7a4561e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097999 Sep 02 04:31:37.082284 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 192/402] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:31:36 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:31:37.261228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563624269", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "26ff5384-f842-4306-a318-71b587753ace"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:37.504187 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] validate_networks() for [('26ff5384-f842-4306-a318-71b587753ace', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:31:37.786642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:37.787245 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:37.793368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:37.793809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:37.794558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:37.794983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:37.892222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:31:37.892697 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:31:37.893095 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:31:37.893501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:31:37.893906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:31:37.902397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:37.902842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:37.903631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:37.904097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:37.919268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:37.921756 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:31:37.927003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Getting quotas for user c05601393e5948458fd6e350520776c5 and project 30c709f5c0524e4384bdb829d81c46c1. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:31:37.927273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-412c7616-8c4c-4bfd-b2cc-8071bcc3c8ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.145065 Sep 02 04:31:37.927878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 193/403] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:37 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:37.937977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:31:37.940934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:31:38.062519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:38.063214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:38.069123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:38.069566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:38.070356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:38.070827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:38.158653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-00eccc5c-b1dc-46fa-8276-f92a7eb003a8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901706 Sep 02 04:31:38.159214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 211/404] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:31:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 04:31:38.175300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8f251b66-8a60-4034-b518-89914ea8451e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:38.175936 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8f251b66-8a60-4034-b518-89914ea8451e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:38.217607 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:38.228595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-99834eb0-e484-4da6-b113-65b654340af0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.169752 Sep 02 04:31:38.240246 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 194/405] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:38 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:38.240964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8f251b66-8a60-4034-b518-89914ea8451e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:38.243482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8f251b66-8a60-4034-b518-89914ea8451e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1217 microversion: 2.1 time: 0.078171 Sep 02 04:31:38.252662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 212/406] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:38 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:38.943136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:38.944750 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:38.949526 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:38.950005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:38.950842 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:38.951272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:39.071226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:39.078654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b17c43d2-0665-4209-a7e4-522f23f2dfd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.139185 Sep 02 04:31:39.079754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 195/407] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:38 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:39.246689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:39.247360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:39.254407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:39.254859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:39.255660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:39.256144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:39.260251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:39.260869 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:39.267164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:39.267615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:39.268422 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:39.268840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:39.340341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:39.349800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7472d1cc-2e19-4e64-b7fc-47cfb52c5f09 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.093285 Sep 02 04:31:39.350371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 196/408] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:39 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:39.385754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:39.394642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cf90e954-41ac-40ef-9bb7-f4ee10e45c1d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.151049 Sep 02 04:31:39.394909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 213/409] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:39 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:40.095484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:40.096130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:40.102220 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.102676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.103429 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.103885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.269535 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:40.278315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-43441be2-cbbf-4fca-a9d8-98f80f1d6fcb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.185461 Sep 02 04:31:40.279324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 197/410] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:40 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:40.367502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:40.368141 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:40.373960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.374398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.375150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.375579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.411737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:40.412382 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:40.418357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.419039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.419996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:40.420609 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:40.450114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:40.465902 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-81a5e088-9415-44b3-9692-1638301c5e76 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.102325 Sep 02 04:31:40.466486 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 214/411] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:40 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:40.581336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:40.591834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2171b037-397d-490a-b738-db5a020d54b1 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.183329 Sep 02 04:31:40.592891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 198/412] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:40 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:41.281767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cffb85c9-6185-46a0-b4c7-1b2542285d3f"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:41.282874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:41.288739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.289185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.289979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.290412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.299001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:41.299001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:41.302973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.303419 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.304216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.304647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.443897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:41.451598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1359d6bc-8367-4d40-abb4-dd7c411a6454 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.159486 Sep 02 04:31:41.452182 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 199/413] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:41 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:41.483598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:41.484214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:41.489850 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.490281 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.491051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.491471 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.565721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:41.574785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-31a91542-fd80-45f3-938c-17e5f51bc62e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.094396 Sep 02 04:31:41.575357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 200/414] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:41 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:41.629332 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:41.629940 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:41.636039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.636620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.637417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.637846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.766562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:41.774473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c70c4e47-2098-4885-908d-442b5f4bc29e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.148926 Sep 02 04:31:41.775016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 201/415] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:41 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:41.895236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:41.895677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:41.901853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.902291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.903035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:41.903458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:41.926115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'flavor' on Instance uuid 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:31:42.536448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c710fbe4-f35e-45ff-b5d5-f8140bd81734 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 202 len: 0 microversion: 2.20 time: 0.644673 Sep 02 04:31:42.537597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 202/416] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:31:41 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:31:42.544221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:42.545034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:42.552785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.553237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:42.554143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.554566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:42.678625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:42.687094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1d0ff42f-517c-40b7-8722-278d07939529 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.148119 Sep 02 04:31:42.687933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 203/417] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:42 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:42.693721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:42.694516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:42.700763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.701212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:42.702161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.702592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:42.839475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:42.847210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:42.848730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:42.849889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9e305f8c-b4f3-4468-890d-f2bdb6a02aa3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.160217 Sep 02 04:31:42.850440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 204/418] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:42 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:42.854748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:42.855344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:42.861610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.862066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:42.862846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:42.863309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.165529 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:43.174045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d7e6cc65-8a6b-4d3f-a744-96926b134202 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.322615 Sep 02 04:31:43.175360 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 205/419] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:42 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:43.178853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:43.179447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:43.185156 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.185592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.186338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.186759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.316766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:43.324132 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-35fcb1a1-a97c-4601-9829-5cbb75a5ffab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.148548 Sep 02 04:31:43.324707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 206/420] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:43 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:43.705678 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:43.706443 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:43.712619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.713067 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.713891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.714324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.852002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:43.854201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-46f3ed6d-1073-46c1-83e5-236a641098fb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.153318 Sep 02 04:31:43.854763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 207/421] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:43 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:43.867689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:43.868346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:43.873946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.874391 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:43.875141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:43.875572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.007747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:44.015365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:44.016880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:44.018122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fe2c37c7-3c8a-436e-bc89-0e24208bfd2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.153885 Sep 02 04:31:44.018624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 208/422] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:43 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:44.190876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:44.191480 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:44.197719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.198154 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.198986 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.199449 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.268907 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:44.305052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4c6321aa-02ab-4161-9e44-3caa5e2f823a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.117789 Sep 02 04:31:44.305642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 209/423] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:44 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:44.341228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:44.342169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:44.350298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.350945 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.352169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.352754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.500044 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:44.508260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-45ace07c-9ba0-46f0-a476-08be6143b4e5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.170811 Sep 02 04:31:44.508829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 210/424] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:44 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:44.871307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:44.872007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:44.882133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.883354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:44.886718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:44.890273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.017758 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.026733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-74343748-314a-4463-b2bf-ca97c08ec6f9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.159998 Sep 02 04:31:45.034682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 211/425] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:44 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:45.039199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:45.039809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:45.045889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.046338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.047129 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.047587 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.179469 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.189125 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.190636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.191831 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a5cd70d6-2bef-4ae1-bf08-12ada6365a68 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.156374 Sep 02 04:31:45.192450 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 212/426] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:45 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:45.323286 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:45.323886 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:45.329990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.337498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.337498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.337498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.413323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.423631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d29ebf44-9695-4428-b00a-02be549eeb49 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.103380 Sep 02 04:31:45.432949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 213/427] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:45 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:45.526651 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:45.527269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:45.534196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.534909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.536081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:45.536667 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:45.722420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:45.730624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dbff0a64-6aa0-4ab4-ac0e-a35d70b427a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.208266 Sep 02 04:31:45.741152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 214/428] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:45 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:46.043045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:46.044001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:46.049783 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.050234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.051029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.051470 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.183792 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.191208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-67fc0b0a-ce19-4ecb-a0ab-2ff9656b3520 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.152341 Sep 02 04:31:46.192142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 215/429] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:46 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:46.210658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:46.211448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:46.218566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.219014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.220556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.220995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.362696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.373781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.375589 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.377418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6192d3b8-240d-4625-bb5e-94364531495d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.170841 Sep 02 04:31:46.378021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 216/430] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:46 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:46.451165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:46.451779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:46.458463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.458907 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.459668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.460126 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.520318 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.527599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5e0dfda3-f99d-43dc-a873-ec1d02d94e10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.089612 Sep 02 04:31:46.528199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 217/431] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:46 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:46.748337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:46.748961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:46.755656 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.756130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.756882 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:46.757305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:46.887459 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:46.898868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4bcb29de-d5f8-40b4-ae65-909f74803234 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.153294 Sep 02 04:31:46.908435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 218/432] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:46 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:47.209556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:47.210307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:47.229447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.230054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.234491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.234884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.366877 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:47.373014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-944db872-42c7-4721-b752-b7464f311da2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.167729 Sep 02 04:31:47.373590 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 219/433] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:47 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:47.396036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:47.396888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:47.405205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.405653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.406421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.406851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.561707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:47.569790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:47.571283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:47.572474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9a4e3652-6f38-4436-b315-b304e3d859a7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.180207 Sep 02 04:31:47.573030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 220/434] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:47 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:47.577385 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:47.577976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:47.585858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.586436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.587319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.587799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.683696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:47.695634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1778540e-ade9-4253-938c-88d8f0cd7808 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.117838 Sep 02 04:31:47.696336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 221/435] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:47 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:47.970285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:47.970285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:47.970285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.970285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:47.970631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:47.970631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.067581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.075874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f9c1fd52-8679-407a-9f87-87e8a3ce3cca tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.164295 Sep 02 04:31:48.076667 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 222/436] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:47 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:48.399332 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:48.400735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:48.409666 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.410457 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.412625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.413480 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.591051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.591051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-efd7daf4-5b6d-45a2-be3f-930c11ad5edc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.181012 Sep 02 04:31:48.591051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 223/437] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:48 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:48.594066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:48.594698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:48.601416 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.601871 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.602623 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.603228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.748220 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.757521 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.759062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.760270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-64d4c0d0-0e75-47fd-9d1d-a2b3d8c8c190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.170950 Sep 02 04:31:48.760965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 224/438] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:48 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:48.765516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:48.766398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:48.773441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.773887 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.774636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:48.775063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:48.877063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:48.881634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fee07891-74d9-4f17-9220-d9c6ea4f8922 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.119515 Sep 02 04:31:48.882152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 225/439] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:48 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:49.098461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:49.099141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:49.106547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.106994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.107760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.108226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.290767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:49.300634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e505be17-b953-4f7b-8f56-586f9d101946 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.206661 Sep 02 04:31:49.308136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 226/440] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:49 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:49.598764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:49.599439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:49.605268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.605703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.606448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.606874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.744712 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:49.752299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-010ae087-aeac-4268-96de-bfa2c977ea27 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.157977 Sep 02 04:31:49.752865 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 227/441] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:49 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:49.778642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:49.779483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:49.787128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.787590 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.790749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:49.791227 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:49.977243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:49.985560 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:49.987104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:49.988417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e011f92b-7991-4516-8354-f2334c9c32de tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.213547 Sep 02 04:31:49.989152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 228/442] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:49 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:49.993251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:49.993852 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:49.999600 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.000081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.001380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.001805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.066658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:50.074379 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-96622939-dc02-4c31-a11f-e129bca5822d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.084433 Sep 02 04:31:50.084081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 229/443] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:49 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:50.318525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:50.319192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:50.331506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.331506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.331506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.331506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.449211 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:50.458125 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1ea2b42c-c1e3-4a4f-a82c-704e778946e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.143558 Sep 02 04:31:50.459204 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 230/444] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:50 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:50.769042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:50.772973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:50.779319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.779818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.780620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:50.781054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:50.912670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:50.920869 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-496f2e3e-67ad-4083-884c-3490dbe861af tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.155508 Sep 02 04:31:50.921444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 231/445] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:50 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:51.006923 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:51.007645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:51.020679 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.021146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.021949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.022377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.157445 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:51.167650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:51.169188 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:51.170421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-00407eff-b546-4253-882f-d5a4deb1c3d6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.167569 Sep 02 04:31:51.171184 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 232/446] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:51 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:51.175382 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:51.184943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:51.184943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.184943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.184943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.185935 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.257056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:51.269640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-df8e1af7-d03c-4035-b6e4-e685e78b8e5d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.097566 Sep 02 04:31:51.270218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 233/447] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:51 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:51.476862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:51.477646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:51.484181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.484708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.485553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.486404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.620171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:51.627928 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f32efeeb-4284-4fcb-97b6-c447ab080192 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.156293 Sep 02 04:31:51.628511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 234/448] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:51 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:51.940979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:51.941756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:51.947544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.948148 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:51.948911 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:51.949334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.078819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.086672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3ecd53fe-d928-4280-bc7f-308516efec6e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.150510 Sep 02 04:31:52.096719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 235/449] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:51 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:52.193602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:52.194125 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:52.204704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.205946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.207946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.208831 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.363580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.371272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.372804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.373946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9c2f9245-558e-4a41-9abb-f37e650bfd99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.184711 Sep 02 04:31:52.374710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 236/450] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:52 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:52.379207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:52.379805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:52.385329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.389432 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.389432 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.389432 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.459166 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.467373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b2283d00-e3d4-4668-8119-69aa508ddb5a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.091878 Sep 02 04:31:52.468018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 237/451] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:52 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:52.644673 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:52.645465 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:52.651264 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.651788 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.652903 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:52.653213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:52.779478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:52.787087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a1ce560c-bcd2-4f9e-b207-e82f22d1e47f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.146069 Sep 02 04:31:52.787943 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 238/452] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:52 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:53.104235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:53.104901 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:53.111337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.111779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.112566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.112999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.231244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.239014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fca6a910-6147-4355-ae79-0fdeb5c2c2ac tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.138813 Sep 02 04:31:53.239597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 239/453] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:53 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:53.392970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:53.393591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:53.399181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.399622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.400397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.400822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.522713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.530559 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.532647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.540933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-21409b7d-5551-499c-9c6b-1ca0368aad5f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.145096 Sep 02 04:31:53.540933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 240/454] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:53 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:53.540933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:53.540933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:53.545063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.545497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.546296 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.546718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.608098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.615775 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-272e070a-0e27-4f34-b081-85d129bfaf88 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.080235 Sep 02 04:31:53.616363 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 241/455] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:53 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:53.810240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:53.810849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:53.817019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.817481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.818234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:53.818662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:53.940329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:53.947664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-859b16a6-623e-45fe-b00f-02c477ec23d3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.141262 Sep 02 04:31:53.948252 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 242/456] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:53 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:54.254537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:54.255154 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:54.261123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.261674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.262452 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.262973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.377835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:54.384936 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4f903e8b-5fae-4001-97a3-42922716d673 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.133993 Sep 02 04:31:54.385505 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 243/457] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:54 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:54.554225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:54.554763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:54.560430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.560884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.561682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.562114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.685167 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:54.693439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:54.694956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:54.696152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f20a24bb-621f-4dce-a23f-60dc51a418ac tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.145746 Sep 02 04:31:54.697080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 244/458] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:54 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:54.701348 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:54.701949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:54.708289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.708738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.709497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.709922 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.771381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:54.778803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ec70d7a0-d645-40f1-b83a-b4c60383871e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.080692 Sep 02 04:31:54.779719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 245/459] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:54 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:54.964434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:54.965034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:54.971404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.971845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:54.972621 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:54.973045 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.089150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.096885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-38d9ad2b-0838-44ff-960e-ea73e459839e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.136076 Sep 02 04:31:55.097454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 246/460] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:54 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:55.401941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:55.402590 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:55.408279 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.408720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.409469 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.409897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.525276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.532939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ed16d9e2-d784-4bf3-8055-1622e1ec1770 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.134663 Sep 02 04:31:55.533505 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 247/461] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:55 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:55.714305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:55.714903 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:55.721336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.721769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.722535 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.722954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.840561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.848832 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.850325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.851759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c205e930-1b14-4181-9504-9bd70e1a5d93 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.141190 Sep 02 04:31:55.852335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 248/462] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:55 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:55.856390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:55.856980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:55.862225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.862656 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.863394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:55.863814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:55.920577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:55.927969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-778d7aae-0fae-401f-96a6-3481642d2b6e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1221 microversion: 2.1 time: 0.074687 Sep 02 04:31:55.928892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 249/463] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:55 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:56.114012 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:56.114619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:56.120328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.127298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:56.127298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.127298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:56.342560 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:56.351945 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5997e9c8-9e5d-45e7-b603-27d649463cc7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.242074 Sep 02 04:31:56.352571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 250/464] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:56 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:56.550343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:56.551071 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:56.557427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.557938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:56.558780 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.559201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:56.811509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:56.825412 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d421e69c-d2e9-460d-b8ae-fbe4842a8f33 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.279480 Sep 02 04:31:56.827204 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 251/465] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:56 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:56.870159 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:56.871142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:56.879076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.879764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:56.881444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:56.882133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.118326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.130024 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.133485 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.135139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-46cbad6b-2cde-41ee-98e3-6fc20b7a85f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.268884 Sep 02 04:31:57.148259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 252/466] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:56 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:31:57.151575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bcb64ce0-3303-4e6d-a672-dcc46abfa643 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.871579 Sep 02 04:31:57.155390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:57.156242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 215/467] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:31:41 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments => generated 194 bytes in 15879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:57.156494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:57.164466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.165826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.166809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.167533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.262868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.270117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e8f3a355-328c-4a80-9f93-7c75040971c0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1269 microversion: 2.1 time: 0.119327 Sep 02 04:31:57.270749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 253/468] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:57 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:57.286006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-67521a72-3a30-4c30-af85-a5c9364dfa9a req-521021f2-c146-4d81-ae6b-0fea2263460c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:57.287729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:31:57.287729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:31:57.296929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-67521a72-3a30-4c30-af85-a5c9364dfa9a req-521021f2-c146-4d81-ae6b-0fea2263460c service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.298097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-67521a72-3a30-4c30-af85-a5c9364dfa9a req-521021f2-c146-4d81-ae6b-0fea2263460c service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.310184 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-67521a72-3a30-4c30-af85-a5c9364dfa9a req-521021f2-c146-4d81-ae6b-0fea2263460c service nova] Creating event network-changed:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:31:57.316566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-67521a72-3a30-4c30-af85-a5c9364dfa9a req-521021f2-c146-4d81-ae6b-0fea2263460c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Sep 02 04:31:57.317729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 216/469] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:31:57.369386 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:57.370141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:57.377371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.377547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.378229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.378719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.618433 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.631585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9e7c8c8f-5a51-440b-a14f-61a3ca78a4fd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.263113 Sep 02 04:31:57.631585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 254/470] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:57 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:57.843346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:57.844078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:57.856601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.856601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.856601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:57.856601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:57.980907 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:57.988555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d6b53e0c-a038-4d38-856b-650b02162d7e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.149728 Sep 02 04:31:57.989177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 217/471] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:57 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:58.154182 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:58.154759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:58.160570 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.161019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.161794 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.162227 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.278467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:58.286645 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:58.287243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:58.287368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:58.288959 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:58.290230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-90dae6cb-2eeb-4d3b-8944-07334c11d3ee tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.139910 Sep 02 04:31:58.293493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 255/472] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:58 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:58.294108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.294108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.294277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.294624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.351685 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:58.358574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4b9f240d-e407-43ff-84ca-73751c42e59b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1277 microversion: 2.1 time: 0.075528 Sep 02 04:31:58.359128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 218/473] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:58 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1277 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:58.645425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:58.646119 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:58.651931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.652369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.653114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.653538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.767999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:58.775065 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ac434cb0-910b-4e62-8d23-f33c8569a343 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1501 microversion: 2.1 time: 0.133195 Sep 02 04:31:58.775619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 256/474] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:58 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1501 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:31:58.791856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8052a0df-e8e1-4465-8ee3-082777633183"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:58.792942 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:58.798659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.799131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.799965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.800358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.822896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] HTTP exception thrown: Cannot 'attach_volume' instance 3ffde743-fe81-4cab-9344-57ca521c59f4 while it is in vm_state rescued Sep 02 04:31:58.823487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Returning 409 to user: Cannot 'attach_volume' instance 3ffde743-fe81-4cab-9344-57ca521c59f4 while it is in vm_state rescued {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:31:58.824433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4dee30ba-ef54-40c9-9e48-325872977bfa tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.036348 Sep 02 04:31:58.825249 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 219/475] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:31:58 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 04:31:58.833809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:31:58.834414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:58.840052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.840494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:58.841241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:58.841666 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.004434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:59.005103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:59.010896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.011334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.012113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.012652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.030425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8eb03e69-72c3-4156-b64e-0b90f83e1b58 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action" status: 202 len: 0 microversion: 2.1 time: 0.200012 Sep 02 04:31:59.031059 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 257/476] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:31:58 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:31:59.039737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:59.040448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:59.046444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.046899 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.048334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.048769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.132448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.139688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4f83b881-856b-4bf4-8241-f53abd963514 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.138903 Sep 02 04:31:59.140294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 220/477] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:58 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:59.169645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.177403 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6c4236ef-bf41-4482-83aa-024868d6c517 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.141468 Sep 02 04:31:59.177994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 258/478] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:59 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:31:59.309056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:59.309662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:59.315880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.316356 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.317105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.317538 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.375871 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:31:59.376721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:31:59.382894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.383333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.384112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:31:59.384534 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:31:59.433826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.442576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.442726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.444117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:31:59.445436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-729166e7-867c-4bbf-93f9-aa72aa3112e4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.140074 Sep 02 04:31:59.445988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 221/479] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:31:59 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:31:59.449731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7f4b7be6-6251-47c1-bd83-b9bb19735b54 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1277 microversion: 2.1 time: 0.077611 Sep 02 04:31:59.451243 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 259/480] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:31:59 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1277 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:00.155995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:00.156557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:00.163374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.163819 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.164610 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.165040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.194141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:00.194776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:00.200649 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.201110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.201845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.202266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.282592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.290739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a274b337-5c84-4b89-bf53-d73ec2bb1aeb tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.138425 Sep 02 04:32:00.291310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 222/481] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:00 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:00.324765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.332391 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ef1f2490-8ada-4b0b-a294-ff774492db5e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.141912 Sep 02 04:32:00.332944 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 260/482] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:00 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:00.465808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:00.466473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:00.466927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:00.467525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:00.472313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.472759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.473484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.473605 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.473924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.474033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.474670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:00.475146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:00.536659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.543979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fb48fd46-3d90-4a1b-a6bf-f9e1299e002d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1287 microversion: 2.1 time: 0.081819 Sep 02 04:32:00.544550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 223/483] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:00 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:00.591625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.599149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.600666 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:00.602062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-348127c0-5460-4acd-aec2-2024aa654bc7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.138721 Sep 02 04:32:00.602605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 261/484] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:00 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:01.307228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:01.307880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:01.314113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.314558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.315364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.315793 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.349657 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:01.356830 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:01.367814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.368537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.369317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.369755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.453801 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.461699 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ed3c34c3-a1a4-4d7d-beef-e1f38e1573ef tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.158345 Sep 02 04:32:01.462383 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 224/485] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:01 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:01.560940 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:01.561617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:01.567522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.568001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.568772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.569575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.631041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.638488 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-50bf53de-fa6a-4d75-83a2-fa0d3d2bee9e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1275 microversion: 2.1 time: 0.081457 Sep 02 04:32:01.640808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 225/486] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:01 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:01.647100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:01.647100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:01.652681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.653376 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.654287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:01.654751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:01.797845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.806242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.807735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.808921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-47402f08-72d1-4025-b2f3-01480bf08d7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.168947 Sep 02 04:32:01.809474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 226/487] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:01 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:01.974136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:01.981646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7c59febd-9eab-4085-8b3d-b4f6a57a870f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.636153 Sep 02 04:32:01.982233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 262/488] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:01 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:02.479874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:02.480599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:02.486259 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.488496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.488496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.488496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.626073 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:02.634092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-40284b93-cfe0-43c5-ad1c-ea25c1bf4f55 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.158127 Sep 02 04:32:02.636329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 227/489] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:02 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:02.660022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:02.661408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:02.667132 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.667563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.668542 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.668966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.826511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:02.827113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:02.833741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.834173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.834937 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:02.835353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:02.881561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:02.893758 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f83b4ceb-041f-462d-8c0d-deb2285181d0 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.237670 Sep 02 04:32:02.903194 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 263/490] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:02 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:02.968859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:02.976929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:02.978714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:02.979860 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e8faeda0-6613-4e4a-807b-17ea22906415 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.157143 Sep 02 04:32:02.980443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 228/491] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:02 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:02.997519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:02.998124 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:03.005762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.006211 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.007714 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.007714 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.221814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:03.229554 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9976c7d3-612d-4501-9622-bd455718da3b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.235671 Sep 02 04:32:03.230127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 264/492] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:02 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:03.410526 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-a725b82f-1523-4968-9f13-2183da084974 req-1345219c-f309-4b49-9912-cdb69e31e828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4", "tag": "846e5756-d0e2-4d37-9ea2-cfd9eaf04460"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:03.412177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:03.412177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:03.418810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a725b82f-1523-4968-9f13-2183da084974 req-1345219c-f309-4b49-9912-cdb69e31e828 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.419242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a725b82f-1523-4968-9f13-2183da084974 req-1345219c-f309-4b49-9912-cdb69e31e828 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.430684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-a725b82f-1523-4968-9f13-2183da084974 req-1345219c-f309-4b49-9912-cdb69e31e828 service nova] Creating event network-changed:846e5756-d0e2-4d37-9ea2-cfd9eaf04460 for instance 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 on hv-cinder-80473 Sep 02 04:32:03.435399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-a725b82f-1523-4968-9f13-2183da084974 req-1345219c-f309-4b49-9912-cdb69e31e828 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028903 Sep 02 04:32:03.436003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 229/493] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:03.651306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:03.651827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:03.657637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.658080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.659332 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.659757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.779277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:03.786816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-927dfdfd-ca44-483e-b416-4afecdcd3d09 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.139245 Sep 02 04:32:03.789413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 265/494] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:03 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:03.910758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:03.911418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:03.917299 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.917740 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.918494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:03.918912 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:03.997876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:03.998482 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:04.005002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.005467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.006204 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.006634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.042068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.049496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-39d70356-73d4-4621-a8c5-d4bc9aab9096 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.142802 Sep 02 04:32:04.050096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 230/495] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:03 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:04.123205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.130858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.132388 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.133594 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-44332a86-b374-4249-a1bd-791f0341c4ec tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.139405 Sep 02 04:32:04.134145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 266/496] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:03 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:04.246210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:04.246898 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:04.253524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.253964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.254715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.255147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.373471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.380689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c6f51d01-5fff-44c9-ba15-79b53f1cbbfc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.138093 Sep 02 04:32:04.381255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 231/497] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:04 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:04.802765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:04.803390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:04.809143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.809559 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.810305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:04.810723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:04.927510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:04.934579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6efedbbb-803f-4ade-acf1-3f32e59cb9ba tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.135984 Sep 02 04:32:04.935128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 267/498] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:04 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:05.066534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:05.067161 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:05.073034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.073474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.074223 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.074653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.152047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:05.152677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:05.158374 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.158807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.159558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.160073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.191550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:05.198851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-544dfca5-a61d-4e4e-8b90-0ec8023b48ec tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.136436 Sep 02 04:32:05.205064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 232/499] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:05 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:05.284334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:05.292579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:05.294151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:05.295296 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a04d5684-51b5-4192-8459-fc1f938b6271 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.147019 Sep 02 04:32:05.295868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 268/500] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:05 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:05.397560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:05.398171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:05.404042 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.404439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.405199 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.405658 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.524826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:05.532027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2f5d27a1-a9e6-49e8-a3bb-54ae9e2668bc tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.138209 Sep 02 04:32:05.535047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 233/501] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:05 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:05.950706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:05.952075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:05.959002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.959506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:05.960516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:05.960941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.165591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.173185 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1f23120f-6d0f-412e-b6d5-a7afaa536e90 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.226138 Sep 02 04:32:06.173753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 269/502] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:05 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:06.220243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:06.220989 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:06.227626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.228108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.228866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.229298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.314179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:06.314819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:06.321428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.322100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.324435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.325181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.368651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.386276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0e676405-383d-4e1d-9a3f-1e96ac955bda tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.160111 Sep 02 04:32:06.386923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 234/503] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:06 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:06.475484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.484082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.484403 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.486292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8379f353-d95f-4f45-970c-0d48345100d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.175249 Sep 02 04:32:06.487862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 270/504] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:06 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:06.548564 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:06.549986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:06.581925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.582365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.583283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:06.583729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:06.708417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:06.715683 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a5a80453-1ce6-40e9-8f66-da74367fbb1b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1509 microversion: 2.1 time: 0.170848 Sep 02 04:32:06.716291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 235/505] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:06 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:07.189996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:07.191203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:07.196991 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.201613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.201613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.201613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.321942 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.330203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-96377072-7cc2-466c-81ca-d1ee7ac45919 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.143510 Sep 02 04:32:07.330519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 271/506] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:07 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:07.403679 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:07.404303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:07.410487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.410930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.411680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.412136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.504139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:07.504889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:07.510870 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.511414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.512096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.512525 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.558302 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.566439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-83dd455e-9c1c-4476-8dac-8bfef8f359f2 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.166121 Sep 02 04:32:07.567390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 236/507] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:07 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:07.645674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.653979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.662961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.664158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1fbd7a7c-07e2-4de8-a4ec-dc8fd7e82307 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.163821 Sep 02 04:32:07.664716 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 272/508] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:07 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:07.736189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:07.737525 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:07.746060 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.746569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.747718 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:07.748385 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:07.868869 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:07.875990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-61916c63-593f-471b-a2a7-75887a1b0835 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1515 microversion: 2.1 time: 0.145229 Sep 02 04:32:07.876543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 237/509] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:07 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:08.349875 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:08.350444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:08.359372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.359823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.361167 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.362331 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.499475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:08.507086 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9809fefe-eacd-474d-b129-3d72ad5e034a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.164016 Sep 02 04:32:08.507648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 273/510] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:08 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:08.582713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:08.583559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:08.590438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.590884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.591649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.592111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.682634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:08.683348 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:08.690522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.691018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.692097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:08.696157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:08.722365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:08.730366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7336b0c0-756e-4066-9483-91402197ff2f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.151227 Sep 02 04:32:08.730892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 238/511] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:08 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:08.839601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:08.847684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:08.849328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:08.850564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1027e06b-606b-4b7e-a039-307bccae598f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.171802 Sep 02 04:32:08.851534 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 274/512] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:08 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:09.225567 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1435ee00-f57a-46af-a0ba-4ad870c81e30 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:09.231640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1435ee00-f57a-46af-a0ba-4ad870c81e30 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.232121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1435ee00-f57a-46af-a0ba-4ad870c81e30 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.291821 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1435ee00-f57a-46af-a0ba-4ad870c81e30 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Going to try to stop instance {{(pid=108890) force_stop /opt/stack/nova/nova/compute/api.py:2651}} Sep 02 04:32:09.509931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1435ee00-f57a-46af-a0ba-4ad870c81e30 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 202 len: 0 microversion: 2.1 time: 0.288785 Sep 02 04:32:09.510510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 239/513] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:32:09 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:32:09.522849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:09.523544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:09.524260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.524414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.530550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.530996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.531757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.532186 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.532295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.532722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.538766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.538766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.681225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:09.684740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:09.688448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c91d0ff7-56e5-4204-a3be-3790b5576eec tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.168927 Sep 02 04:32:09.689017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 240/514] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:09 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:09.694264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:09.694873 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.700667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.701115 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.701879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.702311 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.703306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9ce9988a-d288-441e-b58f-045941fd275e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.187912 Sep 02 04:32:09.704253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 275/515] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:09 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:09.746768 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:09.747377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.759012 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.760028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.761650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.762571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.843266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:09.853117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bfe9dbee-7bff-416f-8d58-fa4aebf4c1f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1515 microversion: 2.1 time: 0.162202 Sep 02 04:32:09.853952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 241/516] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:09 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:09.872021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:09.872775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.879498 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.880288 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.881145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.881584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.950529 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:09.962283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2f33cc14-37a3-400f-8cc0-2a336427c404 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.218826 Sep 02 04:32:09.963588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 276/517] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:09 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:09.977707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe91ba99-7923-479c-acaa-701af64c920f"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:09.979358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:09.987395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.987940 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:09.988646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:09.989079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.029176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:10.039361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:10.039888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:10.041067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6cca5153-035d-4da1-b92e-49dc5ce20363 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.175753 Sep 02 04:32:10.041954 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 242/518] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:09 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:10.098275 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-b7aacab5-4be2-4dd7-9187-bfe3ba22448d req-34937aea-c63f-4f59-a948-58a2343b4536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "name": "network-vif-plugged", "status": "completed", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:10.099796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:10.099796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:10.107643 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-b7aacab5-4be2-4dd7-9187-bfe3ba22448d req-34937aea-c63f-4f59-a948-58a2343b4536 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:10.108342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-b7aacab5-4be2-4dd7-9187-bfe3ba22448d req-34937aea-c63f-4f59-a948-58a2343b4536 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.119730 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-b7aacab5-4be2-4dd7-9187-bfe3ba22448d req-34937aea-c63f-4f59-a948-58a2343b4536 service nova] Creating event network-vif-plugged:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:32:10.125595 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-b7aacab5-4be2-4dd7-9187-bfe3ba22448d req-34937aea-c63f-4f59-a948-58a2343b4536 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031017 Sep 02 04:32:10.126172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 243/519] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:10.706713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:10.707400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:10.713268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:10.713708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.714475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:10.714899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.848388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:10.856092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c771658e-6ac5-43ae-a2a5-2803d84b17a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.153970 Sep 02 04:32:10.856669 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 244/520] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:10 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:10.860999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:10.861664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:10.867427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:10.867957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.868656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:10.869091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:10.993532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:11.001230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-14c8ab50-4c26-4a98-9d33-a6a0436a15b8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.143630 Sep 02 04:32:11.001795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 245/521] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:10 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:11.006443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:11.007078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:11.013724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.013724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:11.013921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.014068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cc719988-d720-42aa-a7c2-cfe536208605 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.048674 Sep 02 04:32:11.014533 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:11.014659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 277/522] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:32:09 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:11.060316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:11.061105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:11.068271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.068723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:11.070576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.075743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:11.145646 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:11.153735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-822f9c5e-6ab1-413b-a329-e21a724e5f39 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.150406 Sep 02 04:32:11.159643 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 246/523] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:11 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:11.219297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:11.229650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:11.231255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:11.232687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7db5f6d0-de0f-4294-9369-77c8edb2fc33 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.176664 Sep 02 04:32:11.233385 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 278/524] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:11 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:11.872760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:11.873373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:11.879041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.879487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:11.880264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:11.880789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.019257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:12.020107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:12.026500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.026949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.027720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.028181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.044696 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.052475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fb782248-db83-4917-a1c7-faff4051ae95 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1357 microversion: 2.1 time: 0.183441 Sep 02 04:32:12.053225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 247/525] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:11 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:12.167764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.170642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7b52feeb-ea0d-4289-8e8f-d7943f23dd20 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.155715 Sep 02 04:32:12.171344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 279/526] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:12 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:12.174566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:12.175185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:12.181398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.181845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.182613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.183046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.252182 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:12.253329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:12.259748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.260265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.261197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:12.261642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:12.378234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.387476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.390337 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d22c298c-5e4f-41fe-8f49-184ad6c0dc85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.220010 Sep 02 04:32:12.390924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 248/527] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:12 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:12.397593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.399228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:12.400598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6703c694-9de2-4b60-ba95-6017df89c6ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.152657 Sep 02 04:32:12.410719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 280/528] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:12 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:13.069517 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.070244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.076022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.076539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.077382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.077882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.187203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.187815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.194219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.194849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.195824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.196436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.201581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.209571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-93d64786-0197-4863-aa5d-5abe66c7b7fe tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1545 microversion: 2.1 time: 0.143810 Sep 02 04:32:13.210359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 249/529] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1545 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:13.238425 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.238994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.246623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.247082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.247991 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.248437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.374914 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.383484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9fabce73-cc80-4cf5-abcb-c32e8e62e9e5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.199956 Sep 02 04:32:13.384387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 281/530] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:13.397056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.404719 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8966805a-f202-4c62-84d8-de7579c3de10 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1545 microversion: 2.1 time: 0.171436 Sep 02 04:32:13.405842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 250/531] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1545 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:13.417288 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.417950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.418251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.418866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.425857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.426195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.427146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.427578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.431278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.431793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.432599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.433184 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.568550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.576604 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ff8faea6-0323-4540-b477-d2b676680c34 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.173698 Sep 02 04:32:13.577559 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 282/532] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:13.592458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.595968 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.598760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:13.598760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:13.599845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.603027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.604814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Searching by: {'deleted': False, 'project_id': '13dd2e352f6149d4beb1d4f84664a614'} {{(pid=108891) get_all /opt/stack/nova/nova/compute/api.py:2904}} Sep 02 04:32:13.605249 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.606997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8365e4cd-2c25-43a6-b21c-95fc02441b5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.191903 Sep 02 04:32:13.608055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 251/533] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:13.617837 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.618349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.619275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.620325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.716647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.multi_cell_list [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108891) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 02 04:32:13.818496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1ebf71dc-8214-4b7a-a3f9-b65b9dd3bbd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.239537 Sep 02 04:32:13.819324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 283/534] 10.222.0.13 () {58 vars in 1125 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers => generated 342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:13.829160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:13.831062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:13.836415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.837046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.837816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.838254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.898516 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-82a6e4bf-f527-4633-bcf4-b1b2e082bff9 req-0a9c14d8-b911-4bd9-86af-09c6b22cdf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4", "name": "network-vif-plugged", "status": "completed", "tag": "846e5756-d0e2-4d37-9ea2-cfd9eaf04460"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:13.900164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:13.900164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:13.907684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-82a6e4bf-f527-4633-bcf4-b1b2e082bff9 req-0a9c14d8-b911-4bd9-86af-09c6b22cdf44 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:13.908152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-82a6e4bf-f527-4633-bcf4-b1b2e082bff9 req-0a9c14d8-b911-4bd9-86af-09c6b22cdf44 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:13.920213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-82a6e4bf-f527-4633-bcf4-b1b2e082bff9 req-0a9c14d8-b911-4bd9-86af-09c6b22cdf44 service nova] Creating event network-vif-plugged:846e5756-d0e2-4d37-9ea2-cfd9eaf04460 for instance 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 on hv-cinder-80473 Sep 02 04:32:13.925977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-82a6e4bf-f527-4633-bcf4-b1b2e082bff9 req-0a9c14d8-b911-4bd9-86af-09c6b22cdf44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Sep 02 04:32:13.926760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 284/535] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:13.961226 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:13.968615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-789fbde2-60f7-40b2-a576-f0d2ad6ffec3 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1545 microversion: 2.1 time: 0.143052 Sep 02 04:32:13.969278 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 252/536] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:13 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1545 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:14.401354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:14.402067 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:14.408552 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.408995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.409747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.410177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.530722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:14.539019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4a77f367-39ec-4e70-be8d-efba4b3d189e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.141648 Sep 02 04:32:14.539611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 285/537] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:14 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:14.593720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:14.594319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:14.600996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.601438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.602219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.602650 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.625622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:14.626220 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:14.632634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.633075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.633832 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:14.634258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:14.754948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:14.763745 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dd1f44e7-7bb8-4c19-9f56-8363292f59ea tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.173654 Sep 02 04:32:14.764351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 253/538] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:14 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:14.779376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:14.787210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:14.788738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:14.790095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-caec1def-e76a-4e78-b4b5-a5b6c42c7c41 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.168144 Sep 02 04:32:14.790647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 286/539] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:14 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:15.556003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:15.556523 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:15.562305 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.562748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.563504 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.563963 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.682560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:15.690917 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5960e054-5c45-47f4-b61b-a6d10c42a8e3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.138728 Sep 02 04:32:15.691517 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 254/540] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:15 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:15.781004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:15.781612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:15.788093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.788533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.789308 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.789729 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.808351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:15.808880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:15.824574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.835597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.835597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:15.835597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:15.920858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:15.935322 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-13529408-5aa5-4e58-89b2-1d0ee813c271 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1317 microversion: 2.1 time: 0.158073 Sep 02 04:32:15.935940 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 287/541] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:15 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:15.940399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-994676389", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "36934402-f060-463c-a58a-2b7056c383b5"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:15.965896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:15.974664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:15.976570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:15.977808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dc183e1b-ae42-4207-8e61-72a5eeba1946 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.173251 Sep 02 04:32:15.979039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 255/542] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:15 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:15.993631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] validate_networks() for [('36934402-f060-463c-a58a-2b7056c383b5', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:32:16.575264 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:32:16.575684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:32:16.576210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:32:16.576617 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:32:16.577026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:32:16.586019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.586464 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.587260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.587710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.604244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Getting quotas for project 575695d7181e435fb176d616cafa196c. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:32:16.608098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Getting quotas for user 7fa8d7424a374b0faa2b31eda4ef711b and project 575695d7181e435fb176d616cafa196c. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:32:16.618517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:32:16.620824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:32:16.708362 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:16.708971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:16.715471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.716066 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.716827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.717253 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.748577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-628b6e8a-5286-498e-ad6f-640b8c90732e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811406 Sep 02 04:32:16.749352 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 288/543] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:32:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:32:16.758717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-25685f4a-ef24-4c09-accf-4705407946ca tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:16.759446 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-25685f4a-ef24-4c09-accf-4705407946ca tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:16.814756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-25685f4a-ef24-4c09-accf-4705407946ca tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:16.823807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-25685f4a-ef24-4c09-accf-4705407946ca tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1218 microversion: 2.1 time: 0.068476 Sep 02 04:32:16.824565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 289/544] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:16 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:16.859487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:16.868195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aa5b7fed-6bf4-4996-90a1-5effb5fc7dc6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.164082 Sep 02 04:32:16.868837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 256/545] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:16 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:16.952148 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:16.952887 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:16.959276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.959745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.960599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:16.960954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:16.995652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:16.996341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:17.003022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.003473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.004260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.004696 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.123774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:17.130982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-33e752a2-0beb-4a11-b9cc-18fdf3694f7f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1507 microversion: 2.1 time: 0.182753 Sep 02 04:32:17.131736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 290/546] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:16 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:17.148724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:17.157234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:17.158971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:17.160330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1754b85a-9193-4a35-8a73-688d8f872018 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.168309 Sep 02 04:32:17.160890 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 257/547] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:16 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:17.192645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a445678-c6b2-46f1-83c7-ca4d95a632ef"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:17.203250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:17.203250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.203250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.203250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.203662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.839886 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:17.840512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:17.846347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.846833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.847756 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.848363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.916420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:17.924744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6388c727-815d-4730-a436-30c0ad02a63f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1222 microversion: 2.1 time: 0.088400 Sep 02 04:32:17.925299 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 258/548] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:17 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:17.929815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:17.930418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:17.935951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.936398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:17.937305 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:17.937725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.058751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:18.067208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bdde7333-3c28-4b3a-bbbb-60afa0838d44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.140800 Sep 02 04:32:18.067781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 259/549] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:17 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:18.179399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:18.180244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:18.190729 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-353aaba9-fbec-434c-a1b2-d548ca638dd5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001542 Sep 02 04:32:18.191647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 291/550] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:32:17 2021] POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:18.195503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.196026 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.196900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.197333 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.338318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:18.347868 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:18.349411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:18.350861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a745fdc6-5ac0-4d8e-a14d-11fba804736c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.175931 Sep 02 04:32:18.351547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 260/551] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:18 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:18.942228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:18.943146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:18.946413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccdb08ac-8f9c-47e7-8984-e7d491c89609"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:18.948450 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:18.952737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.953185 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.954157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.954771 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.960675 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.961190 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:18.962385 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:18.962814 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:19.019812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:19.027198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2234da6d-8719-4d67-b207-2aea8c379b47 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1270 microversion: 2.1 time: 0.089498 Sep 02 04:32:19.027761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 292/552] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:18 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:19.084260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:19.084870 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:19.090851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:19.091306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:19.092095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:19.092854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:19.214208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:19.222386 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-36c7c91e-16cf-4a3c-a753-b3c1bfedffd4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.142056 Sep 02 04:32:19.222941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 293/553] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:19 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:19.369493 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:19.370079 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:19.376572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:19.377021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:19.377776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:19.378199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:19.584510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:19.592695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:19.594295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:19.595453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-04abc39e-dfc4-4d51-a6d7-175007061377 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.229675 Sep 02 04:32:19.596085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 294/554] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:19 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:20.047362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:20.048275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:20.054569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.055017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.055820 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.056275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.124396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.128953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2a68d997-6dcf-4178-87c3-1dde703e07fb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "POST /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.187261 Sep 02 04:32:20.130424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 261/555] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:32:18 2021] POST /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:20.133749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c4b503f6-8833-4288-8be2-20e014818f1f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1276 microversion: 2.1 time: 0.089821 Sep 02 04:32:20.135871 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 295/556] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:20 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:20.150374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:20.151512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:20.158297 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.158744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.159554 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.160014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.183795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lazy-loading 'flavor' on Instance uuid 3ffde743-fe81-4cab-9344-57ca521c59f4 {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:32:20.239314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:20.240076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:20.245763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.246196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.246966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.247483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.440695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.448498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3d963be1-5acf-421c-8052-33b642a50df1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.213513 Sep 02 04:32:20.449066 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 296/557] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:20 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:20.614467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:20.615172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:20.622441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.623446 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.623755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.624205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.681897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b04a43c0-f863-4545-955a-a95b46ee993e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action" status: 200 len: 32 microversion: 2.1 time: 0.535258 Sep 02 04:32:20.682503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 262/558] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:32:20 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action => generated 32 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:32:20.691710 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:20.692524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:20.699234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.699867 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.700881 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:20.701323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:20.821773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.829952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ba9476a8-b103-4554-a797-da7c9f1a34b7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.142253 Sep 02 04:32:20.830606 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 263/559] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:20 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:20.869236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.878347 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.879846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:20.881329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6b2434cb-bfb8-4d5b-9d8a-469643bcbe01 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.271237 Sep 02 04:32:20.881904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 297/560] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:20 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:21.150367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:21.150961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:21.157030 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.157550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.158889 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.159320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.294322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:21.302543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c17a8cb1-a487-4e0b-877c-a4c1c2a3d054 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.155821 Sep 02 04:32:21.303152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 264/561] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:21 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:21.464739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:21.465354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:21.472198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.472647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.473414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.473857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.639998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-425d72ee-6824-41a8-8847-e45dde0a83e6 req-0cce023d-867c-40ed-9496-a5229a336564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6512480e-2b4a-48b0-b6d9-1183746b3624", "tag": "a525487b-12c0-45f3-b6ca-68106090802b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:21.641748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:21.641748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:21.641933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:21.650307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-425d72ee-6824-41a8-8847-e45dde0a83e6 req-0cce023d-867c-40ed-9496-a5229a336564 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.650856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0dbffffd-efc9-4167-8618-4cf74274bf37 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.189741 Sep 02 04:32:21.650996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-425d72ee-6824-41a8-8847-e45dde0a83e6 req-0cce023d-867c-40ed-9496-a5229a336564 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.651430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 298/562] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:21 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:21.663721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-425d72ee-6824-41a8-8847-e45dde0a83e6 req-0cce023d-867c-40ed-9496-a5229a336564 service nova] Creating event network-changed:a525487b-12c0-45f3-b6ca-68106090802b for instance 6512480e-2b4a-48b0-b6d9-1183746b3624 on hv-cinder-80473 Sep 02 04:32:21.668755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-425d72ee-6824-41a8-8847-e45dde0a83e6 req-0cce023d-867c-40ed-9496-a5229a336564 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Sep 02 04:32:21.669345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 265/563] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:21.848693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:21.849294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:21.855245 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.855687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.856458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.856879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.901864 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:21.902577 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:21.909107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.909492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:21.910289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:21.910725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:22.057474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.065880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-483cf799-aa82-4195-929a-c027caa06906 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.222495 Sep 02 04:32:22.066587 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 299/564] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:21 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:22.213323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.221601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.223102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.224283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-356288ee-0b5a-4420-8155-e9b56e79a5f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.326518 Sep 02 04:32:22.224842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 266/565] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:21 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:22.325497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:22.325497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:22.325497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:22.325497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:22.326378 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:22.326884 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:22.524941 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.532681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-961f4873-61d8-4b4a-96da-0a902520560d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.218062 Sep 02 04:32:22.533301 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 300/566] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:22 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:22.668282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:22.681999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:22.681999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:22.681999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:22.681999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:22.682388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:22.799660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:22.807549 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-35bebfae-ba8e-4df0-a3cb-de67d225578b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.143226 Sep 02 04:32:22.808244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 267/567] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:22 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:23.083506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:23.084081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:23.090196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.090635 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.091383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.091805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.209187 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.216782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9a038fd3-28ac-4a7f-bd6b-bf923dcf0027 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.137735 Sep 02 04:32:23.217344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 301/568] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:23 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:23.242320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:23.243035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:23.248992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.249515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.250329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.250761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.368089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.376083 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.378320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.379542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1b143f98-8fc8-45c3-8223-f3b461f2c06f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.140937 Sep 02 04:32:23.383562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 268/569] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:23 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:23.553162 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:23.553162 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:23.556393 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.556829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.557572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.557993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.678863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.685810 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-885c7564-66e2-4fbd-a5f1-7899f5595138 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.140178 Sep 02 04:32:23.686374 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 302/570] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:23 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:23.826089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:23.826688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:23.833080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.833522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.834264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:23.834687 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:23.955739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:23.963312 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-04191410-ed96-4f65-8a98-5461bf6d9f4c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.141031 Sep 02 04:32:23.963874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 269/571] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:23 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:24.234047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:24.234571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:24.240299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.240744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.241496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.241928 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.358257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:24.366431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a6e29e6a-d382-4298-ad3c-686d5e7002d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.136102 Sep 02 04:32:24.367000 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 303/572] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:24 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:24.401168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:24.401903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:24.407767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.409168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.409677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.410187 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.528212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:24.536384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:24.537888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:24.539038 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6af3ccc9-ef4a-418b-b9c6-0e9eef3e68b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.141544 Sep 02 04:32:24.539603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 270/573] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:24 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:24.702166 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:24.702782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:24.709173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.709621 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.710377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.710809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.826216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:24.833945 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ca8de9c3-b488-4ca9-a8df-6762ff38fd05 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.135656 Sep 02 04:32:24.834517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 304/574] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:24 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:24.980542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:24.981155 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:24.986826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.987270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:24.988059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:24.988493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.103558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.111214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f1d2f7f3-e4dd-4e8c-9338-b23a88bbf8a7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.134314 Sep 02 04:32:25.111779 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 271/575] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:24 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:25.382890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:25.383418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:25.389665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.390114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.390865 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.391295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.517011 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.525606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a3d0c0b4-f44f-452e-950d-1b653100b62d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.146744 Sep 02 04:32:25.526158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 305/576] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:25 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:25.557407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:25.558016 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:25.563679 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.564157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.564910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.565341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.687842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.696504 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.698023 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.699169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fd27d327-7bf5-41f9-b89d-04d6c0fba405 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.145497 Sep 02 04:32:25.699720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 272/577] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:25 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:25.850313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:25.851189 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:25.857550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.858077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.858932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:25.859350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:25.980464 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:25.987603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ca8385c3-3bfb-4e16-b03c-709129983e90 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.140990 Sep 02 04:32:25.988171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 306/578] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:25 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:26.129896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:26.130496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:26.136391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.136831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.137578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.138005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.262228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:26.270512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-390390e1-ecd7-44e4-ad64-36b07dbb4297 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.144745 Sep 02 04:32:26.271082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 273/579] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:26 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:26.550420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:26.551283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:26.557144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.557599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.558379 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.558815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.681257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:26.689695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-692f8366-44a7-4ed8-93e2-b8c10978b2d8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.149919 Sep 02 04:32:26.690257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 307/580] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:26 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:26.717468 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:26.718074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:26.724802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.725251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.726294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:26.726735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:26.851683 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:26.859534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:26.861067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:26.862215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5d18b197-54ce-40fb-9836-900685fe433e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.148392 Sep 02 04:32:26.862773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 274/581] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:26 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:27.004356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:27.004964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:27.010629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.011073 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.011826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.012286 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.135781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:27.143173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2cf6270a-a7c9-4722-a647-0d0faeb33bc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.142890 Sep 02 04:32:27.144237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 308/582] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:26 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:27.288171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:27.288785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:27.294899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.295353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.296176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.296661 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.419545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:27.427351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a202a764-11cd-44e2-90b3-366b1ac1917b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.142865 Sep 02 04:32:27.427947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 275/583] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:27 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:27.705571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:27.706180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:27.711817 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.712305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.713094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.713544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.835706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:27.842933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4095db72-292d-43a6-9c4e-24244a17a647 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.141109 Sep 02 04:32:27.843671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 309/584] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:27 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:27.880548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:27.881238 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:27.887098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.887537 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.888422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.888851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.900853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:27.901462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:27.907096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.909131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:27.909131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:27.909131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.022765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.030974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.031441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.032684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.033994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f98230b7-ee18-4b9e-a865-5866edaa85f5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1744 microversion: 2.20 time: 0.158168 Sep 02 04:32:28.034553 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 276/585] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:27 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:28.038990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-753f6108-de1f-41e1-befd-b6b5c5bef098 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1591 microversion: 2.1 time: 0.141751 Sep 02 04:32:28.039982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 310/586] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:27 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1591 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:28.160689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:28.161477 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:28.167083 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.167528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.168316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.168749 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.313006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.320765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d40442c3-0239-4df7-b4e8-32f795c391e2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.164447 Sep 02 04:32:28.321321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 277/587] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:28 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:28.444500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:28.445183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:28.450841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.451285 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.452116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.452540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.573193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:28.581365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b49f3139-d196-4b9f-b2e8-6f6103674c8f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.140767 Sep 02 04:32:28.581927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 311/588] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:28 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:28.860349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:28.861460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:28.871293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.871736 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:28.872527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:28.872955 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.052999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:29.053611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:29.059486 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.059960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.060730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.061157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.124079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.131807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eb7a0a68-97bb-4714-a924-9e72111f9052 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.275122 Sep 02 04:32:29.140979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 278/589] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:28 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:29.180050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.187731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.189809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.190960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e88ea1f9-f641-4f5e-ab31-ddc69f7516f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1744 microversion: 2.20 time: 0.142194 Sep 02 04:32:29.191514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 312/590] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:29 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1744 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:29.338281 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:29.338921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:29.344604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.345041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.345963 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.346389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.504225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.511320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b60b752d-4ced-40b5-b464-28f317fe7ada tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.176769 Sep 02 04:32:29.511871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 279/591] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:29 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:29.602233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:29.602233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:29.605935 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.606368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.607110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.607536 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.742220 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:29.750102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d711bd08-ad19-45c8-a4cd-56f9d7e06b27 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.155488 Sep 02 04:32:29.750668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 313/592] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:29 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:29.854126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-ff396176-639d-4ad9-bdab-a5393b884686 req-2b3ba4af-d980-4bc7-9199-1c4741276bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "name": "network-vif-plugged", "status": "completed", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:29.856386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:29.856386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:29.864077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ff396176-639d-4ad9-bdab-a5393b884686 req-2b3ba4af-d980-4bc7-9199-1c4741276bd0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:29.865637 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ff396176-639d-4ad9-bdab-a5393b884686 req-2b3ba4af-d980-4bc7-9199-1c4741276bd0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:29.875734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-ff396176-639d-4ad9-bdab-a5393b884686 req-2b3ba4af-d980-4bc7-9199-1c4741276bd0 service nova] Creating event network-vif-plugged:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:32:29.880624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-ff396176-639d-4ad9-bdab-a5393b884686 req-2b3ba4af-d980-4bc7-9199-1c4741276bd0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030467 Sep 02 04:32:29.881216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 280/593] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:30.148563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:30.149392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:30.155823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.156289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.157064 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.157488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.246599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:30.248381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:30.255208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.259255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.259255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.259255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.319867 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.330747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9b936d91-7bb3-40f6-b25c-0704a139e5f8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.185415 Sep 02 04:32:30.331862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 314/594] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:30 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:30.447961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.459317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.459317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.459317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7d3933e0-ec52-44a6-b3a4-6d481453be99 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1744 microversion: 2.20 time: 0.216714 Sep 02 04:32:30.459644 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 281/595] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:30 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:30.528690 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:30.529293 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:30.535104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.535620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.536476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.536983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.657016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.665425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-57093d42-dc29-4025-890e-52a204111bd6 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.140327 Sep 02 04:32:30.666222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 315/596] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:30 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:30.774101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:30.774708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:30.776266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-43b7b078-4e90-4da5-9fd8-2dfe09fefc8a req-0fb76bed-b8a0-42e7-83fd-b97c894d2e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:30.778100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:30.778100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:30.787829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-43b7b078-4e90-4da5-9fd8-2dfe09fefc8a req-0fb76bed-b8a0-42e7-83fd-b97c894d2e4e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.788717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-43b7b078-4e90-4da5-9fd8-2dfe09fefc8a req-0fb76bed-b8a0-42e7-83fd-b97c894d2e4e service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.791610 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.792092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.795676 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:30.795676 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:30.802155 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-43b7b078-4e90-4da5-9fd8-2dfe09fefc8a req-0fb76bed-b8a0-42e7-83fd-b97c894d2e4e service nova] Creating event network-changed:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:32:30.810097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-43b7b078-4e90-4da5-9fd8-2dfe09fefc8a req-0fb76bed-b8a0-42e7-83fd-b97c894d2e4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036521 Sep 02 04:32:30.814892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 316/597] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:30.950897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:30.959322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2806d6a2-d4b1-4d02-8aff-708967ef1ef6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.193777 Sep 02 04:32:30.964375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 282/598] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:30 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:31.352939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:31.354298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:31.383765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.384292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.390533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.392095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.477990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:31.478970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:31.491433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.492207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.502365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.503068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.643106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:31.652921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-33d374c1-37da-4515-b0ef-200190995ecd tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.305712 Sep 02 04:32:31.665784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 317/599] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:31 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:31.684962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:31.685958 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:31.692311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.693037 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.694023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.694643 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.716098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:31.732743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:31.734257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:31.742744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8ff172c8-ab5b-4ec8-a509-f055d74a29e6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.269068 Sep 02 04:32:31.748753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 283/600] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:31 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:31.919929 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:31.922078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-6ce379d6-352d-43ac-a55c-cf5c317ebbbc req-30095770-d086-4bb1-b919-e39ffbd835f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6512480e-2b4a-48b0-b6d9-1183746b3624", "name": "network-vif-plugged", "status": "completed", "tag": "a525487b-12c0-45f3-b6ca-68106090802b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:31.923848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:31.923848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:31.929358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-77ad9c78-3ea0-4771-8c4c-615cb5d5f6ed tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.249543 Sep 02 04:32:31.930486 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 318/601] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:31 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:31.942571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-6ce379d6-352d-43ac-a55c-cf5c317ebbbc req-30095770-d086-4bb1-b919-e39ffbd835f6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.943140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-6ce379d6-352d-43ac-a55c-cf5c317ebbbc req-30095770-d086-4bb1-b919-e39ffbd835f6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.960164 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-6ce379d6-352d-43ac-a55c-cf5c317ebbbc req-30095770-d086-4bb1-b919-e39ffbd835f6 service nova] Creating event network-vif-plugged:a525487b-12c0-45f3-b6ca-68106090802b for instance 6512480e-2b4a-48b0-b6d9-1183746b3624 on hv-cinder-80473 Sep 02 04:32:31.967832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-6ce379d6-352d-43ac-a55c-cf5c317ebbbc req-30095770-d086-4bb1-b919-e39ffbd835f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051422 Sep 02 04:32:31.969401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 284/602] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:31.984517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:31.985187 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:31.996674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.996674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:31.996674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:31.996674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.215730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:32.228398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-98306f34-9bcf-4cd1-9b28-504308085342 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.249175 Sep 02 04:32:32.240641 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 319/603] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:31 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:32.670990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:32.675332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:32.678648 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.679092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.679852 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.680300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.766917 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:32.768295 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:32.775544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.776320 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.777400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.778193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.825128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:32.833738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-078ac0f0-992d-4af4-9591-b98f4d4879f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.166795 Sep 02 04:32:32.836553 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 285/604] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:32 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:32.948651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:32.949739 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:32.956848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.957522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:32.958685 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:32.959373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:33.002955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:33.013014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:33.015092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:33.016704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-970af4ff-a8a7-41c4-8efc-81b4fcd27051 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.255719 Sep 02 04:32:33.031627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 320/605] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:32 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:33.146142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:33.146142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aa61b2b9-ba33-4bf3-91fb-632ce1b04073 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.200153 Sep 02 04:32:33.146142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 286/606] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:32 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:33.247861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:33.251392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:33.259014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:33.259459 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:33.260435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:33.261030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:33.414338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:33.422468 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9f3cfd67-e90e-459e-afeb-c3cffd50525d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.179219 Sep 02 04:32:33.423031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 321/607] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:33 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:33.860166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:33.860166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:33.865134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:33.866102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:33.867378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:33.867820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.027539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.028165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7ea34907-9fef-4586-bbca-c466fce08eeb tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.180000 Sep 02 04:32:34.029071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 287/608] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:33 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:34.043939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:34.044576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:34.056161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.056161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.056161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.056161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.166174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:34.166706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:34.173032 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.173501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.174279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.174711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.206262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.215055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.216631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.217784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6df10b7a-c04f-4d7b-a88c-34fd4427d042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.177977 Sep 02 04:32:34.218345 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 322/609] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:34 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:34.300264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.307475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-61aab454-cd90-4c39-ac87-dc0c5c1bcb3b tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1318 microversion: 2.1 time: 0.151687 Sep 02 04:32:34.308055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 288/610] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:34 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:34.441524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:34.442157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:34.448072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.448553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.449306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:34.449736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:34.622627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:34.630805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8b3d7e8b-41b2-4abb-9412-f13ac87d94b0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1721 microversion: 2.1 time: 0.192970 Sep 02 04:32:34.644781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 323/611] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:34 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:35.046360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:35.047855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:35.055550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.060240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.060240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.060240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.217224 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.226741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-efafc0c8-c2be-48a5-8bab-2d87d9f15c5d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.184519 Sep 02 04:32:35.243666 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:35.244913 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:35.253418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 289/612] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:35 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:35.255452 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.257421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.258661 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.259303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.330349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:35.331408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:35.342947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.343394 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.347135 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.347758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.444170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.456921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.459376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.461231 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-77762271-22f8-46b1-b211-9419212ac686 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.222241 Sep 02 04:32:35.471952 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 324/613] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:35 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:35.486368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-216052324"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:35.487861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:35.500994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.501544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.502771 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.503567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.601399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.611548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-99f8fc08-684d-4a61-b049-6ed50588c5c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1506 microversion: 2.1 time: 0.289606 Sep 02 04:32:35.612632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 290/614] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:35 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:35.653413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:35.655307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:35.662178 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.662941 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.671744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.672643 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.708390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.network.security_group_api [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Adding security group 670f3a52-44a8-4aaf-8467-f2f14f2921db to port c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 Sep 02 04:32:35.852591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:35.864959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-559578e7-6a5c-4401-924a-f566fe8e885d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1698 microversion: 2.1 time: 0.215250 Sep 02 04:32:35.865856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 291/615] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:35 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1698 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:35.882816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-59546eda-9aa5-4780-9129-18e8813f7a3c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:35.890548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59546eda-9aa5-4780-9129-18e8813f7a3c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:35.890886 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59546eda-9aa5-4780-9129-18e8813f7a3c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:35.916347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-59546eda-9aa5-4780-9129-18e8813f7a3c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Going to try to start instance {{(pid=108890) start /opt/stack/nova/nova/compute/api.py:2674}} Sep 02 04:32:36.203789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-59546eda-9aa5-4780-9129-18e8813f7a3c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 202 len: 0 microversion: 2.1 time: 0.324124 Sep 02 04:32:36.205194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 292/616] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:32:35 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:32:36.215605 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:36.217377 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:36.225241 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.226389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.227375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.228233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.469930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:36.479557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d3b8a4ec-2279-41a1-980d-93fb1694f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1707 microversion: 2.1 time: 0.269418 Sep 02 04:32:36.483752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 293/617] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:36 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1707 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:36.490612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:36.499040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:36.508484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7ba48c72-1ae3-450a-aa4c-7b5b275082a1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action" status: 202 len: 0 microversion: 2.1 time: 1.028137 Sep 02 04:32:36.513596 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 325/618] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:32:35 2021] POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:32:36.514158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.514625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.518133 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.520030 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.520894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:36.521731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:36.549019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.550938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.553908 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.554797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.829584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:36.838775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f66772ae-15b5-4312-bd95-e5a330d8a2f2 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.351698 Sep 02 04:32:36.843404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 294/619] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:36 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:36.846496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:36.847353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:36.874036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.874693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.875639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:36.876948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:36.973838 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:36.986855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:36.994001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:36.994001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d57eb787-5058-414d-9e05-fe6c3efcb3c4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.477274 Sep 02 04:32:37.010247 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 326/620] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:36 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:37.014818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-321feaab-ccad-4957-8337-2ebe40149a69 req-b1a208dc-3bec-40a7-b294-54a13b6f8698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:37.016436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:37.016436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:37.040283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-321feaab-ccad-4957-8337-2ebe40149a69 req-b1a208dc-3bec-40a7-b294-54a13b6f8698 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.040724 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-321feaab-ccad-4957-8337-2ebe40149a69 req-b1a208dc-3bec-40a7-b294-54a13b6f8698 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.062687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-321feaab-ccad-4957-8337-2ebe40149a69 req-b1a208dc-3bec-40a7-b294-54a13b6f8698 service nova] Creating event network-changed:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:32:37.081153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-321feaab-ccad-4957-8337-2ebe40149a69 req-b1a208dc-3bec-40a7-b294-54a13b6f8698 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067614 Sep 02 04:32:37.083142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 327/621] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:37.089139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:37.089800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:37.096761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.100737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.100737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.100737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.127395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:37.140892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b19ad6fe-4559-4d2f-b311-74fb788f379e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1756 microversion: 2.1 time: 0.298448 Sep 02 04:32:37.141485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 295/622] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:36 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1756 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:37.303743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'services' on Instance uuid 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:32:37.500416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:37.502175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:37.528640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.532893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.532893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.532893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.627206 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4b60a98c-cce3-4178-87b8-66d703020d06 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments/ccdb08ac-8f9c-47e7-8984-e7d491c89609" status: 202 len: 0 microversion: 2.1 time: 0.541731 Sep 02 04:32:37.627777 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 328/623] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:32:37 2021] DELETE /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments/ccdb08ac-8f9c-47e7-8984-e7d491c89609 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:32:37.653608 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:37.660181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:37.671403 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.674254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.677114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.677733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.738629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-786e7336-3545-4fde-a74f-092b942a2069 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105505 Sep 02 04:32:37.739157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 329/624] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:37 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:37.770772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:37.783301 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-faaf9be8-d0e1-43af-85d2-f6f895c9fd7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1707 microversion: 2.1 time: 0.286563 Sep 02 04:32:37.789061 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 296/625] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:37 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1707 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:37.857004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:37.857611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:37.869291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.870239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:37.871160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:37.871732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.014783 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:38.015632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:38.022562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.023137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.024353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.024897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.155816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:38.166474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eb2652d6-ccf1-4aa5-a903-97b7aa96bd1f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.313152 Sep 02 04:32:38.177555 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 330/626] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:37 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:38.227813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:38.247993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:38.247993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:38.247993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c9101a4b-5c6d-488b-9a07-cc1bc4af002c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.229817 Sep 02 04:32:38.248403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 297/627] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:38 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:38.749294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:38.750165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:38.756569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.757010 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.757763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.758188 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.788036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c63dabb5-4ec6-4dbe-982f-b63b645be211 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Sep 02 04:32:38.788610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 331/628] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:38 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:38.800887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:38.801494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:38.813417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.814995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.816075 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:38.816633 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:38.949491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:38.958227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a2e75fe0-f563-4ec4-a792-d712be3a5c75 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1707 microversion: 2.1 time: 0.161029 Sep 02 04:32:38.958789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 298/629] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:38 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:39.185532 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:39.186357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:39.193620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.194339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.195213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.195746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.260205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:39.260992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:39.269391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.269932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.270857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.271513 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.362890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:39.373110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-87b50d52-4dd8-4ee5-af3a-491623a1e43c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.191751 Sep 02 04:32:39.374262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 332/630] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:39 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:39.424598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:39.439214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:39.441062 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:39.442393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8c479d99-ab29-4ce6-8945-f39e4a85da18 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.186221 Sep 02 04:32:39.453639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 299/631] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:39 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:39.800527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:39.802055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:39.809476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.810139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.811382 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.812179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.845671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-942a9bf1-b172-4757-9287-2f5f96929edb tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048824 Sep 02 04:32:39.846530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 333/632] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:39 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:32:39.975042 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:39.975977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:39.982403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.982846 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:39.983620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:39.984088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:40.121848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:40.130996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6133b298-a84d-4ebe-88d5-3a7bc85c56be tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1711 microversion: 2.1 time: 0.158801 Sep 02 04:32:40.141317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 300/633] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:39 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1711 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:40.391349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:40.392253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:40.398372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:40.398995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:40.399753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:40.400205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:40.460878 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:40.461492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:40.468322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:40.468822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:40.469603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:40.470575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:40.558355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:40.568604 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f736ab9b-f220-476c-91f1-c42e402ea203 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.180363 Sep 02 04:32:40.576294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 334/634] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:40 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:40.625258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:40.638732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:40.638981 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:40.640722 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fe0f96c5-3e47-461b-97ec-3d81bdec4b11 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.183796 Sep 02 04:32:40.656232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 301/635] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:40 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:41.281914 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:41.283117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:41.294336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.296608 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.298290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.299373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.326971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:32:41.629269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:41.629269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:41.629269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.629269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.631314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.631314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.792282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:41.802399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c80b130d-f929-4b44-9cb2-4bb436e8de47 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.218079 Sep 02 04:32:41.803328 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 302/636] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:41 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:41.814020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:41.814020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:41.819733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.820195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.821093 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:41.821587 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:41.975132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:41.983502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:41.985072 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:41.986886 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-13484533-0e87-4b95-946e-a3c5f50bdb90 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.182195 Sep 02 04:32:41.987440 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 303/637] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:41 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:42.529900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-43690067-bd04-4a54-9317-7abc41ba9eae tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 204 len: 0 microversion: 2.1 time: 1.251308 Sep 02 04:32:42.530538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 335/638] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:32:41 2021] DELETE /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 0 bytes in 1253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:32:42.538890 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:42.539541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:42.545423 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:42.545802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:42.546548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:42.546971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:42.677491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:42.686101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-05cb65f8-72a2-4249-ad78-189b45a7edf9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1513 microversion: 2.1 time: 0.150796 Sep 02 04:32:42.686923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 304/639] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:42 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:42.822953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:42.824330 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:42.830719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:42.831133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:42.831857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:42.832263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:42.971771 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:42.982160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3ec82158-89d1-4e17-a25a-56f4b04da84e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.164864 Sep 02 04:32:42.982766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 336/640] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:42 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:43.006236 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:43.006852 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:43.013105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:43.013825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:43.014593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:43.015019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:43.152230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:43.160429 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:43.162021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:43.163168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8eab09cf-0cb0-47d9-a222-05b7fbf793c7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.161689 Sep 02 04:32:43.163983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 305/641] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:43 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:43.702168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:43.702768 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:43.709029 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:43.709469 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:43.710218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:43.710647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:43.837540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:43.845834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4dd0abb3-ca76-4d76-8a25-40b7b5ccfc64 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1513 microversion: 2.1 time: 0.146545 Sep 02 04:32:43.846411 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 337/642] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:43 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:44.003789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:44.004426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:44.010370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.010843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.011599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.012067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.136491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:44.145075 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d42df779-a795-45f4-af16-cdbecf0debdf tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.145472 Sep 02 04:32:44.145642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 306/643] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:43 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:44.181521 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:44.182131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:44.188033 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.188475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.189781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.190212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.311494 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:44.320319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:44.321853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:44.323103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0eeac604-341b-41a4-a3bf-3f10b3178ea9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1739 microversion: 2.20 time: 0.145255 Sep 02 04:32:44.323688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 338/644] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:44 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1739 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:44.862330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:44.862938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:44.868828 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.869273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.870031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:44.870464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:44.990904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:44.998638 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-974d20ed-9693-4acd-add1-a4f473616e45 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1513 microversion: 2.1 time: 0.139975 Sep 02 04:32:44.999212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 307/645] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:44 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:45.161922 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:45.163149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:45.169128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:45.169740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:45.170873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:45.171302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:45.341348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:45.342056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:45.348638 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:45.349079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:45.349889 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:45.350746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:45.444880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:45.456841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-46223ec1-5af6-41a9-8420-65aa1628ff13 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.298605 Sep 02 04:32:45.457684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 339/646] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:45 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:45.498574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:45.506469 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:45.508031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:45.509200 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b4da2024-35c1-40f6-93a0-b97e690e691f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1721 microversion: 2.20 time: 0.171730 Sep 02 04:32:45.510459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 308/647] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:45 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:45.926752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-95f5b7fe-8875-46a3-93c4-3d9b8be72e3a req-86f585d5-9217-436f-b856-19449cfc0c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4", "name": "network-vif-deleted", "tag": "846e5756-d0e2-4d37-9ea2-cfd9eaf04460"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:45.928722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:45.928722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:45.935431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-95f5b7fe-8875-46a3-93c4-3d9b8be72e3a req-86f585d5-9217-436f-b856-19449cfc0c34 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:45.940498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-95f5b7fe-8875-46a3-93c4-3d9b8be72e3a req-86f585d5-9217-436f-b856-19449cfc0c34 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:45.946498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-95f5b7fe-8875-46a3-93c4-3d9b8be72e3a req-86f585d5-9217-436f-b856-19449cfc0c34 service nova] Creating event network-vif-deleted:846e5756-d0e2-4d37-9ea2-cfd9eaf04460 for instance 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 on hv-cinder-80473 Sep 02 04:32:45.953274 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-95f5b7fe-8875-46a3-93c4-3d9b8be72e3a req-86f585d5-9217-436f-b856-19449cfc0c34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 Sep 02 04:32:45.954081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 340/648] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:46.015336 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:46.015962 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:46.022426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.022865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.023615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.024081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.091004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:46.099979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fe642cfc-efcc-4566-abb0-7773fe0bc25f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1471 microversion: 2.1 time: 0.088077 Sep 02 04:32:46.120487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 309/649] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:46 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1471 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:46.476441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:46.477092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:46.483232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.483670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.484447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.484872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.527400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:46.528188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:46.534463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.535558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.536485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:46.536992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:46.613310 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:46.623430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fbf330c9-ed69-4803-b2b9-f2e1fb63c856 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.152811 Sep 02 04:32:46.624223 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 341/650] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:46 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:46.660442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:46.668055 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:46.669556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:46.670711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-58207c26-2088-4c1c-8204-cf5f1aee4b6a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1721 microversion: 2.20 time: 0.146987 Sep 02 04:32:46.671265 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 310/651] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:46 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:47.127256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:47.127994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:47.135649 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.136105 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.136856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.137364 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.170023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.170454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.170888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'fault' on Instance uuid 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:32:47.213673 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:47.220992 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7494c29b-7dd5-4e59-88df-f95efea77282 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 200 len: 1307 microversion: 2.1 time: 0.097406 Sep 02 04:32:47.221551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 342/652] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:47 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:47.640035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:47.640949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:47.646748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.647190 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.648004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.649093 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.688207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:47.688806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:47.694589 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.695035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.695800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.696258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.792286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:47.801194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a90b2a3-1065-4c37-92ca-bf6683b22b40 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.164190 Sep 02 04:32:47.801778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 311/653] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:47 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:47.835681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:47.844440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:47.845919 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:47.847602 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6aca530c-59bb-470f-8dbf-40de4cfd7b36 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1721 microversion: 2.20 time: 0.162915 Sep 02 04:32:47.848575 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 343/654] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:47 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:47.893929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-cd466639-40b7-478f-9674-928838b85e64 req-3f5b89e0-7d3c-451c-a705-f862e709d443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "name": "network-vif-unplugged", "status": "completed", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:47.895521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:47.895521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:32:47.903456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-cd466639-40b7-478f-9674-928838b85e64 req-3f5b89e0-7d3c-451c-a705-f862e709d443 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:47.905181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-cd466639-40b7-478f-9674-928838b85e64 req-3f5b89e0-7d3c-451c-a705-f862e709d443 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:47.916196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-cd466639-40b7-478f-9674-928838b85e64 req-3f5b89e0-7d3c-451c-a705-f862e709d443 service nova] Creating event network-vif-unplugged:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:32:47.921362 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-cd466639-40b7-478f-9674-928838b85e64 req-3f5b89e0-7d3c-451c-a705-f862e709d443 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031081 Sep 02 04:32:47.921862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 312/655] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:48.238343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:48.238949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:48.245176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.245652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.246460 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.246916 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.262447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Instance 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 could not be found. Sep 02 04:32:48.263120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 404 to user: Instance 4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:32:48.264097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a99bb2d1-01c2-46af-9b57-3237762f0b10 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4" status: 404 len: 111 microversion: 2.1 time: 0.029928 Sep 02 04:32:48.264647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 344/656] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:48 2021] GET /compute/v2.1/servers/4720ae3f-00b0-45bf-a87e-ba9a86a8d3d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:32:48.819046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:48.819764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:48.825809 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.826268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.827004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.827437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.866986 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:48.867578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:48.873519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.873964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.874736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:48.875164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:48.957307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:48.962737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-daf9b394-6e5a-4fd1-8d60-c08dcb4cb2ab tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.147735 Sep 02 04:32:48.963313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 313/657] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:48 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:48.999219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:49.007874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:49.010448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:49.012093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f2b92c93-b908-483a-9103-265931dc9fcf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1664 microversion: 2.20 time: 0.149369 Sep 02 04:32:49.012665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 345/658] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:48 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:49.030017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "752c0e77-689a-4b2c-936b-2a87ae4afa57"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:49.032107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:49.037654 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:49.038111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:49.038843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:49.039339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:49.529240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:49.531271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:49.536247 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:49.536686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:49.537467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:49.537894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:49.561470 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:32:50.076642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ec659926-285b-4aa5-997d-3b430c12f405 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 204 len: 0 microversion: 2.1 time: 0.550578 Sep 02 04:32:50.077419 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 346/659] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:32:49 2021] DELETE /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:32:50.083360 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:50.090145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:50.090946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.091392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.092207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.092635 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.220751 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:50.228654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-76d97415-24ee-47e7-8e8a-c8090740628c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1567 microversion: 2.1 time: 0.150108 Sep 02 04:32:50.229215 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 347/660] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:50 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:50.233447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:50.234163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:50.240694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.246439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.246439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.246439 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.365399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:50.372601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-23c740dd-4fb2-4c70-a2d6-65a832bbfe31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1513 microversion: 2.1 time: 0.142466 Sep 02 04:32:50.373164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 348/661] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:50 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:50.504875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c1e879cc-de01-4b6c-bd53-1b097ae4773e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.478739 Sep 02 04:32:50.505642 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 314/662] 10.222.0.13 () {62 vars in 1364 bytes} [Thu Sep 2 04:32:49 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 188 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:32:50.623836 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:50.624425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:50.630864 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.631313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.632118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.632550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:50.983078 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b04d16e5-552c-4f93-a6ef-3b872b394190 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action" status: 202 len: 0 microversion: 2.20 time: 0.362962 Sep 02 04:32:50.983600 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 349/663] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:32:50 2021] POST /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:32:50.992079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:50.992691 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:50.999306 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:50.999741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.000537 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.000969 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.120184 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.129285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.137479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.137479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c5cdd8ee-92bc-4862-bf1c-6e1d7900ab97 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1750 microversion: 2.20 time: 0.143543 Sep 02 04:32:51.137479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 315/664] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:50 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1750 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:51.246184 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:51.246736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:51.252704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.253896 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.254550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.254996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.384145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.390104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:51.390800 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:51.392679 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e47768b7-984b-41b3-b240-d020c36ef700 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1547 microversion: 2.1 time: 0.150401 Sep 02 04:32:51.397354 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.398040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.398817 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.399249 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.410642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 350/665] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:51 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:51.416625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:51.417323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:51.423298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.423742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.424652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.425963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.530402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ffde743-fe81-4cab-9344-57ca521c59f4 while it is in vm_state rescued Sep 02 04:32:51.531120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Returning 409 to user: Cannot 'detach_volume' instance 3ffde743-fe81-4cab-9344-57ca521c59f4 while it is in vm_state rescued {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:32:51.532142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-aa252956-4e4f-44a5-b954-27ae7743f820 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments/fe91ba99-7923-479c-acaa-701af64c920f" status: 409 len: 152 microversion: 2.1 time: 0.120388 Sep 02 04:32:51.539408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 351/666] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:32:51 2021] DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments/fe91ba99-7923-479c-acaa-701af64c920f => generated 152 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 04:32:51.547479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:51.548305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:51.555373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.555812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.556605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.557035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.606634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.614515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-68c243c2-a2ac-4e3d-8164-87399986b67f tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1513 microversion: 2.1 time: 0.227991 Sep 02 04:32:51.615080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 316/667] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:51 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:51.767597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a087d407-2c97-43bb-a678-627da283ced8 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action" status: 202 len: 0 microversion: 2.1 time: 0.223559 Sep 02 04:32:51.769305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 352/668] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:32:51 2021] POST /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:32:51.782711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:51.783622 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:51.791594 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.792170 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.793025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:51.793569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:51.931001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:51.940925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-45f3f3c0-3710-4c51-91e7-12a42b99b644 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1555 microversion: 2.1 time: 0.167559 Sep 02 04:32:51.941571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 317/669] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:51 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:52.151663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:52.152753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:52.160627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.161087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:52.161925 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.162539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:52.312164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:52.320856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:52.322449 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:52.323594 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0421009c-21d0-4348-973e-66331b63a9ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1750 microversion: 2.20 time: 0.176189 Sep 02 04:32:52.324250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 353/670] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:52 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:52.631127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:52.631724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:52.637757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.641048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:52.641048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.641048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:52.771474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:52.779797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2a28f210-1ce7-4ea1-ab98-4181c2bc069e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1513 microversion: 2.1 time: 0.153049 Sep 02 04:32:52.780413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 318/671] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:52 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:52.957327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:52.959623 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:52.963845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.964323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:52.965083 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:52.965517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.155990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:53.163612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-559d79e5-ba92-4c78-8772-646f4ab1291a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1555 microversion: 2.1 time: 0.209970 Sep 02 04:32:53.164200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 354/672] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:52 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:53.342723 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:53.343572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:53.350643 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.354529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.354529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.354529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.354822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-7a3b0965-9a26-4dcc-933a-c072949b57b7 req-b19c389e-060d-4c2e-a353-8c92ac15adc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad777a2-0af2-4029-b809-76f5a1e1ca17", "name": "network-vif-deleted", "tag": "7fab62ca-8e68-4404-bd59-4dcece51f30a"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:53.354822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:32:53.354822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:32:53.365093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-7a3b0965-9a26-4dcc-933a-c072949b57b7 req-b19c389e-060d-4c2e-a353-8c92ac15adc2 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.365773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-7a3b0965-9a26-4dcc-933a-c072949b57b7 req-b19c389e-060d-4c2e-a353-8c92ac15adc2 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.380541 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-7a3b0965-9a26-4dcc-933a-c072949b57b7 req-b19c389e-060d-4c2e-a353-8c92ac15adc2 service nova] Creating event network-vif-deleted:7fab62ca-8e68-4404-bd59-4dcece51f30a for instance 6ad777a2-0af2-4029-b809-76f5a1e1ca17 on hv-cinder-80473 Sep 02 04:32:53.386540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-7a3b0965-9a26-4dcc-933a-c072949b57b7 req-b19c389e-060d-4c2e-a353-8c92ac15adc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Sep 02 04:32:53.387120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 355/673] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:53.481556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:53.490792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:53.492422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:53.495735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0addc0c3-0183-4079-b03a-461e2677f96d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1752 microversion: 2.20 time: 0.154966 Sep 02 04:32:53.495735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 319/674] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:53 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:53.802051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:53.807027 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:53.809072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.809511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.810266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.810760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.840298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:53.840738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:53.841180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'fault' on Instance uuid 6ad777a2-0af2-4029-b809-76f5a1e1ca17 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:32:53.880456 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:53.887568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3be54796-f75d-4d26-9e01-1c0ea2c6a882 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 200 len: 1308 microversion: 2.1 time: 0.090471 Sep 02 04:32:53.888323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 356/675] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:53 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:54.179714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:54.180264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:54.185903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.186346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.187098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.187529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.313590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:54.321221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0b35392b-bfef-40b9-9dbc-8016c8784140 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1555 microversion: 2.1 time: 0.145203 Sep 02 04:32:54.321784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 320/676] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:54 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:54.512346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:54.512955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:54.519368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.519815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.520593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.521022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.638030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:54.646935 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:54.652107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:54.652107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6f8500c1-d4c0-460e-b949-8fd96c8f2a57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1752 microversion: 2.20 time: 0.141092 Sep 02 04:32:54.652107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 357/677] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:54 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1752 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:54.904319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:54.911410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 6ad777a2-0af2-4029-b809-76f5a1e1ca17] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:54.911410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.912033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.913462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.914225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.929349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Instance 6ad777a2-0af2-4029-b809-76f5a1e1ca17 could not be found. Sep 02 04:32:54.930202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 404 to user: Instance 6ad777a2-0af2-4029-b809-76f5a1e1ca17 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:32:54.930893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7910da95-0775-4d43-8a36-41cac146bb9a tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17" status: 404 len: 111 microversion: 2.1 time: 0.030339 Sep 02 04:32:54.931628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 321/678] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:54 2021] GET /compute/v2.1/servers/6ad777a2-0af2-4029-b809-76f5a1e1ca17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:32:54.941452 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:54.942212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:54.948960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.949708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.950698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:54.951250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:54.977773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:32:55.258585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7abc910c-0247-4161-b626-43787430e9e9 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 204 len: 0 microversion: 2.1 time: 0.322152 Sep 02 04:32:55.259396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 358/679] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:32:54 2021] DELETE /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:32:55.266963 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:55.267575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:55.273350 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.273791 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.274540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.274967 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.338431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:55.339316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:55.346054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.346496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.347773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.348233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.397457 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:55.404951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8bc0324c-2cd7-4df3-a798-71b582d5ff17 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.141610 Sep 02 04:32:55.405521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 322/680] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:55 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:55.472905 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:55.480846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3f40be6a-b8dd-4126-8f34-92eb3b1ab5be tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1555 microversion: 2.1 time: 0.147095 Sep 02 04:32:55.481410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 359/681] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:55 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:55.666398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:55.667000 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:55.672765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.673215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.673971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:55.674401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:55.801089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:55.809091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:55.810569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:55.811707 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-13230af0-77b9-4f7e-a8ee-e4a69957c0ff tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.149041 Sep 02 04:32:55.812318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 323/682] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:55 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:56.423872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:56.424648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:56.430619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.431172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.431971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.432410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.498347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:56.498955 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:56.504872 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.505320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.506077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.506509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.621387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:56.625278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6c2bf534-547b-4630-b9a4-8144ad950dee tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.205312 Sep 02 04:32:56.626044 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 360/683] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:56 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:32:56.632844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:56.640650 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e99bd36b-bd3f-4719-9b5a-c46a30da8c51 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1561 microversion: 2.1 time: 0.146030 Sep 02 04:32:56.641203 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 324/684] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:56 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:56.711670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:56.712177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:56.718103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.718576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.719334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.719760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.801729 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lazy-loading 'services' on Instance uuid 3ffde743-fe81-4cab-9344-57ca521c59f4 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:32:56.829792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:56.830484 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:56.836876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.837611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.838235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.838738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:56.959086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:56.967338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:56.968869 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:56.970231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fb621918-9979-4e26-9403-076258c4e82c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.144023 Sep 02 04:32:56.970682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 325/685] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:56 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:56.982774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f53bb7cb-ad98-4026-a9d3-45cbbe454e7f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments/fe91ba99-7923-479c-acaa-701af64c920f" status: 202 len: 0 microversion: 2.1 time: 0.274723 Sep 02 04:32:56.985225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 361/686] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:32:56 2021] DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments/fe91ba99-7923-479c-acaa-701af64c920f => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:32:56.992282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:56.993258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:56.999036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:56.999479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:57.000257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:57.000742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:57.029736 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d6bcbe66-25a5-45f3-a889-190fc9d9ba50 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Sep 02 04:32:57.030287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 326/687] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:56 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:32:57.643565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:57.644437 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:57.651228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:57.651670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:57.652538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:57.652910 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:57.785710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:57.793580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e24243bf-9454-4a46-8058-dee371a5ec31 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.154274 Sep 02 04:32:57.795961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 362/688] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:57 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:57.992490 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:57.993518 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:58.002574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.003237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.004150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.004714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.041551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:58.043498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:58.052069 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.052782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.053559 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.054021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.088431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-85ac30cc-afd9-4127-a3f3-6a8f68dcb540 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050581 Sep 02 04:32:58.089204 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 363/689] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:58 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:58.146858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:58.156254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:58.158193 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:58.159547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cdeea3cc-a921-4309-a256-6096843572af tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.173824 Sep 02 04:32:58.160617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 327/690] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:57 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:32:58.215277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fd4636e-c2ef-4759-bded-1fc52009b570", "device": "/dev/sdb"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:32:58.216880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:58.222933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.223408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.224210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.224647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.813028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:58.813634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:58.820140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.820580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.821344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:58.821775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:58.956596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:58.964460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3db1494a-5256-4b9e-9b96-4de5962293db tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.154949 Sep 02 04:32:58.965027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 328/691] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:58 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:32:59.099581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:59.100726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:59.106590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.107029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:59.107773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.108229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:59.137737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-57832542-290d-4ff1-8ebd-bcfbaba3092c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042469 Sep 02 04:32:59.138491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 329/692] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:32:59 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:32:59.179590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:59.180284 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:59.186167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.186603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:59.187381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.187807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:59.309682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:59.318174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:59.319640 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:32:59.320803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8bef743c-28f0-4fec-a1fc-ebe55f22da61 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.144973 Sep 02 04:32:59.321355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 330/693] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:32:59 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:32:59.982225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:32:59.982829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:32:59.989235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.989679 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:32:59.990454 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:32:59.990882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:00.109934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:00.117784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2cc28c1d-79fe-4ac8-918d-1711d4667583 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.139222 Sep 02 04:33:00.118350 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 331/694] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:32:59 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:00.149025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:00.149928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:00.155741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:00.156206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:00.156959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:00.157380 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:00.186527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-38133063-0367-45ef-8b0a-3936718045a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Sep 02 04:33:00.187073 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 332/695] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:00 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:33:00.339405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:00.340128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:00.346353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:00.347294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:00.348146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:00.348570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:00.473948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:00.482737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:00.484232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:00.485425 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-98f89d04-4b13-478e-9c12-c59fb26e89f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.149770 Sep 02 04:33:00.486259 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 333/696] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:00 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:01.134500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:01.135217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:01.141276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.141724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.142479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.142909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.263056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:01.271067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9bdc50db-296e-49db-8a35-58c782f79f4d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.140281 Sep 02 04:33:01.271818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 334/697] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:01 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:01.284887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:01.285826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:01.291972 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.292395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.293166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.293595 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.324856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-97834d6f-435d-4b67-bce8-14ec0e9d5853 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Sep 02 04:33:01.325421 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 335/698] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:01 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:01.504824 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:01.505433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:01.511506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.511947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.512712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:01.513149 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:01.635355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:01.644155 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:01.646557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:01.647959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-18b47137-40ba-41f7-9df2-832ce90fff96 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.147561 Sep 02 04:33:01.649262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 336/699] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:01 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:02.291536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:02.291536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:02.295221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.295663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.296592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.297081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.420225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:02.427431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-02628836-d2c8-4fec-bed4-9cf37abb64b1 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.144135 Sep 02 04:33:02.428017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 337/700] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:02 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:02.440187 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:02.441108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:02.447047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.447487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.448276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.448705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.478510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4e921e39-184f-4f1f-bf3a-471e116a09de tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049472 Sep 02 04:33:02.479050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 338/701] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:02 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:02.667302 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:02.667844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:02.674441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.674882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.675649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:02.676102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:02.796968 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:02.805544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:02.807101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:02.808296 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6fd568a8-3f45-4729-a39d-cc36f1218d00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.145484 Sep 02 04:33:02.808970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 339/702] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:02 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:03.444773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:03.445540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:03.451857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.452334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.453238 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.453670 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.580437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:03.587752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a8e50f43-2972-4a5c-bd98-7e83fa56eef4 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.147441 Sep 02 04:33:03.588334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 340/703] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:03 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:03.592677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:03.593561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:03.599486 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.600217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.600972 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.601405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.633663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e13c8d32-1b66-4017-8bd5-ea426727d67e tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Sep 02 04:33:03.634266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 341/704] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:03 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:03.826716 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:03.827346 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:03.833931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.834298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.835056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:03.835489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:03.970158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:03.978770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:03.980255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:03.981409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b39b69ef-9ed2-4658-aa25-877293b30109 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.158401 Sep 02 04:33:03.981960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 342/705] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:03 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:04.606875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:04.607570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:04.615497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:04.616018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:04.616816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:04.617243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:04.745918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:04.753359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-510566b1-3a27-4c6d-aebb-4f10f62a2279 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.151142 Sep 02 04:33:04.753929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 343/706] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:04 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:04.758279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:04.759200 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:04.765142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:04.765583 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:04.766341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:04.766926 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:04.797438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-14424789-cc92-497a-bb40-719d74210f81 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Sep 02 04:33:04.798181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 344/707] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:04 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:05.000586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:05.001225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:05.007767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.008236 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.008992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.009417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.136943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:05.145613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:05.147091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:05.148382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7c111335-0ca6-4d71-8519-3ed044510d04 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.151692 Sep 02 04:33:05.148929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 345/708] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:04 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:05.770167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:05.770825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:05.776856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.777297 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.778074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.778489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.906509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:05.914476 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c3ed475e-50b7-4aa6-80e4-7641bbfb8aa8 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.148026 Sep 02 04:33:05.915048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 346/709] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:05 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:05.919557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:05.922219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:05.930276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.931025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.932323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:05.932945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:05.965100 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7e2326c0-d3dd-4d1f-88ab-73004fac131b tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048597 Sep 02 04:33:05.967938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 347/710] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:05 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:06.166448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:06.166965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:06.172900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:06.173343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:06.174104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:06.174536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:06.299209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:06.308367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:06.309863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:06.311024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-db6d4c88-b23c-469d-a6a2-d9b4d2ec2336 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.148390 Sep 02 04:33:06.311590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 348/711] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:06 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:06.931500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:06.932215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:06.938025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:06.938466 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:06.939221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:06.939727 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:07.059818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:07.068001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c0424460-a242-4bfd-84d1-cb182bb5dc9b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.140087 Sep 02 04:33:07.068807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 349/712] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:06 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:07.073124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:07.074048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:07.079927 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:07.080389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:07.081185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:07.081618 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:07.113014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b6a25aaf-431e-4fcf-90a0-59a1ec52cc2c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Sep 02 04:33:07.113583 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 350/713] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:07 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:07.329938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:07.330618 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:07.337336 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:07.337781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:07.338579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:07.339008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:07.467481 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:07.476951 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:07.478605 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:07.480136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fc62b120-f2e6-4a32-9184-7708fabb2675 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.153888 Sep 02 04:33:07.480693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 351/714] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:07 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:08.084714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:08.085436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:08.091207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.091653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.092442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.092877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.224728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:08.232747 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1fa23fea-77a3-4811-9cb7-c762f2164d85 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.152366 Sep 02 04:33:08.233535 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 352/715] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:08 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:08.238851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:08.240494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:08.250439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.250904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.251693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.252156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.283598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-942c999c-42cf-454c-9a0f-1aedd0ad4228 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049222 Sep 02 04:33:08.287128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 353/716] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:08 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:08.498854 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:08.499378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:08.505462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.505903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.506667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:08.507096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:08.630084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:08.638726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:08.640330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:08.641495 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-20e76a76-2978-4c9e-b298-54b970c4ce1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.146694 Sep 02 04:33:08.642059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 354/717] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:08 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:09.078211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:09.079165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:09.085061 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.085726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.086507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.086761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.345268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5fe6c3ae-14ca-44a5-8f69-192922daf1a5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action" status: 202 len: 0 microversion: 2.1 time: 0.270398 Sep 02 04:33:09.347597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 355/718] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:33:09 2021] POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:33:09.351478 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:09.352689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:09.358361 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.358805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.359660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.360124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.486496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:09.496081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d8ad3e51-213c-44e2-b291-cdbd4d37e673 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.148226 Sep 02 04:33:09.496788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 356/719] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:09 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:09.502751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:09.503662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:09.510551 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.511003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.511777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.512250 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.545186 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-48874831-c6f2-4464-963a-543ee6729f00 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Sep 02 04:33:09.545764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 357/720] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:09 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:09.550677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:09.551282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:09.557222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.557678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.558437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.558900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.684628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:09.692644 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-baac5639-47a4-494b-8a40-f70664c348a0 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1748 microversion: 2.1 time: 0.145919 Sep 02 04:33:09.693208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 358/721] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:09 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1748 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:09.697688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:09.698363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:09.704044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.704482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.705228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:09.705686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:09.827532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:09.836140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:09.837639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:09.838811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-277b4d81-f88e-447a-8a67-5e7bf60f6a00 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.144703 Sep 02 04:33:09.839455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 359/722] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:09 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:10.512781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:10.513448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:10.519811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.520286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.521103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.521539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.641669 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:10.649390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6dcfe02c-8c2e-44ac-9e60-43a0e8db0685 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.140426 Sep 02 04:33:10.649949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 360/723] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:10 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:10.654384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:10.655391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:10.661385 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.661835 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.662887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.663416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.691106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-461152cb-07a6-443f-be14-d06e8ef65e7d tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040158 Sep 02 04:33:10.691649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 361/724] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:10 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:10.712014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:10.712623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:10.718017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.718466 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.719216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.719652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.838372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:10.847535 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1677c8b8-331e-404e-a7c9-0c566c59805d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1748 microversion: 2.1 time: 0.138724 Sep 02 04:33:10.848124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 362/725] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:10 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1748 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:10.859393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:10.860056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:10.865808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.866258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.867019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:10.867455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:10.983752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:10.991891 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:10.993396 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:10.994542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3430a2d3-5475-4f97-8b13-13e8498c7c56 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.138712 Sep 02 04:33:10.995099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 363/726] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:10 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:11.533485 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:33:11.534409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:33:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624/os-volume_attachments (ip 10.222.0.13) !!! Sep 02 04:33:11.665682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:11.666596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:11.673077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.679604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.679604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.679604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.802681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:11.810033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e2118f57-25a0-4bd2-8a68-ff954933353b tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1513 microversion: 2.1 time: 0.147977 Sep 02 04:33:11.810701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 364/727] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:11 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:11.825458 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:11.826417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:11.832468 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.832918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.833675 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.834105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.865712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a0d3ee33-dac4-4421-a168-beaa247239c6 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 02 04:33:11.869371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 365/728] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:11 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:11.870800 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:11.871635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:11.878923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.879387 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.880171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:11.880600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:11.986870 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a3c8536c-4734-47ac-9bb7-0f7bba479fc2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "POST /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.775253 Sep 02 04:33:11.988588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 364/729] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:32:58 2021] POST /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624/os-volume_attachments => generated 194 bytes in 13778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:12.019127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:12.019755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:12.026743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.027292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.028325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.028924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.032004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:12.041078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-af629062-37e4-46e6-a598-4f58204cf43f tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1748 microversion: 2.1 time: 0.173801 Sep 02 04:33:12.041654 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 366/730] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:11 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:12.049952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-2e3a68d7-923d-4edb-bea2-938eddd1d72f req-a26e83d9-b464-4b8a-87e8-ae2f64c6f158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f6d300-6517-4e4b-9e8e-be0fab5c385c", "name": "network-vif-deleted", "tag": "cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:12.051451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:12.051451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:33:12.068399 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-2e3a68d7-923d-4edb-bea2-938eddd1d72f req-a26e83d9-b464-4b8a-87e8-ae2f64c6f158 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.068909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-2e3a68d7-923d-4edb-bea2-938eddd1d72f req-a26e83d9-b464-4b8a-87e8-ae2f64c6f158 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.096977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-2e3a68d7-923d-4edb-bea2-938eddd1d72f req-a26e83d9-b464-4b8a-87e8-ae2f64c6f158 service nova] Creating event network-vif-deleted:cef5c1fb-9d7a-44cb-85ae-f249b60c4cc7 for instance 62f6d300-6517-4e4b-9e8e-be0fab5c385c on hv-cinder-80473 Sep 02 04:33:12.103338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-2e3a68d7-923d-4edb-bea2-938eddd1d72f req-a26e83d9-b464-4b8a-87e8-ae2f64c6f158 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059417 Sep 02 04:33:12.104213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 367/731] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:12.177245 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:12.185680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:12.187526 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:12.189194 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9a2e5a73-874a-4967-8b5b-c2d38e3818f7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.174600 Sep 02 04:33:12.189755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 365/732] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:12 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:12.831343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:12.832156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:12.838194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.838713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.839543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.840079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.870515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.870968 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.871403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'fault' on Instance uuid 62f6d300-6517-4e4b-9e8e-be0fab5c385c {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:12.879031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:12.880349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:12.886122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.887058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.887969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:12.888518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:12.912056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:12.919492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6fff5677-2a6b-4726-8c57-f01994160b83 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 200 len: 1308 microversion: 2.1 time: 0.092751 Sep 02 04:33:12.920023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cafc723f-d788-4223-9f98-9a45ef48a600 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046086 Sep 02 04:33:12.928885 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 368/733] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:12 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:12.929174 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 366/734] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:33:12 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:33:13.057166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:13.057773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:13.063418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.063868 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.064651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.065084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.187493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:13.195718 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e035f7ad-8827-4420-8a36-c17c5d4d0b68 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.142288 Sep 02 04:33:13.196286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 369/735] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:13 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:13.208875 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:13.209879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:13.220979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.220979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.220979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.220979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.360731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:13.369909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:13.371395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:13.372578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f3772c88-2a1c-430f-846d-72d582636e2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.168167 Sep 02 04:33:13.373134 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 367/736] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:13 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:13.936541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:13.937079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 62f6d300-6517-4e4b-9e8e-be0fab5c385c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:13.943234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.943348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.944181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:13.944622 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:13.958416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Instance 62f6d300-6517-4e4b-9e8e-be0fab5c385c could not be found. Sep 02 04:33:13.959007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 404 to user: Instance 62f6d300-6517-4e4b-9e8e-be0fab5c385c could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:13.959828 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9bd3493c-5d09-458b-81e1-7cbb0898a96e tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c" status: 404 len: 111 microversion: 2.1 time: 0.027147 Sep 02 04:33:13.960403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 370/737] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:13 2021] GET /compute/v2.1/servers/62f6d300-6517-4e4b-9e8e-be0fab5c385c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:33:14.212658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:14.213289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:14.220781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:14.220781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:14.221503 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:14.221881 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:14.358405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:14.366042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b2b16290-a3e3-43df-a1c8-3386aebaf251 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.157060 Sep 02 04:33:14.367491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 368/738] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:14 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:14.390210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:14.390819 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:14.397134 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:14.397579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:14.398330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:14.398763 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:14.516208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:14.525290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:14.526776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:14.528044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a1d2bd01-67ea-48e0-a2ab-d6b0f619bfa9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.141445 Sep 02 04:33:14.528601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 371/739] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:14 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:15.250247 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:15.250734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:15.256432 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.256863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.257603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.258023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.282290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:33:15.384742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:15.385363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:15.396044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.396044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.396044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.396044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.515021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:15.523471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-648ff485-e0fb-4c62-9e40-fe6024e5b7fc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.142474 Sep 02 04:33:15.524208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 372/740] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:15 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:15.546123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:15.546712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:15.553159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.553597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.554400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.554945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.678894 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:15.687296 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:15.694575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:15.694575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-38212072-626b-409d-8f61-3a4641a7fc8c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.147762 Sep 02 04:33:15.694815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1510fafc-c21e-42c4-a224-5ca5d00f2a0d tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 204 len: 0 microversion: 2.1 time: 0.443201 Sep 02 04:33:15.694929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 373/741] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:15 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:15.695030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 369/742] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:33:15 2021] DELETE /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:33:15.695128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:15.695547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:15.700431 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:15.701130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:15.701701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.702144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.702905 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.703424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.706858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.707377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.708236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:15.708735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:15.728976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:33:15.832122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:15.839297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1a0c19b7-bb2b-4c0b-8e31-b16801645c84 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1514 microversion: 2.1 time: 0.142709 Sep 02 04:33:15.839846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 370/743] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:15 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:16.075433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-59267538-a9a8-4cd9-b334-21a73dc2c9c3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 204 len: 0 microversion: 2.1 time: 0.383423 Sep 02 04:33:16.076056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 374/744] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:33:15 2021] DELETE /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:33:16.083776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:16.084405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:16.090954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.091392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.092168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.092593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.212113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.219211 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-142e9ba9-cd35-4044-bed0-78da52bc4828 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1508 microversion: 2.1 time: 0.139159 Sep 02 04:33:16.219779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 371/745] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:16 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:16.540416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:16.541113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:16.546839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.547277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.548054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.548478 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.667319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.675124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-529f1849-4c81-4529-aa8c-a149740446aa tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.138719 Sep 02 04:33:16.675716 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 375/746] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:16 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:16.709023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:16.709568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:16.715213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.715647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.716426 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.716852 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.832146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.840200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.841681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.842815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a33ac98a-d90e-4b2a-bce0-020c458d4f1d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.138093 Sep 02 04:33:16.843373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 372/747] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:16 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:16.856515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:16.857127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:16.862776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.863221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.864029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:16.864460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:16.980197 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:16.987315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d68572d2-995f-4472-8fab-77a6ad4fc8ad tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1514 microversion: 2.1 time: 0.134514 Sep 02 04:33:16.987875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 376/748] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:16 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1514 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:17.236383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:17.237496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:17.243262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.243695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:17.244465 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.244888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:17.359875 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:17.366946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8c4cd509-7409-4394-ab76-6fc94833c497 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1508 microversion: 2.1 time: 0.134191 Sep 02 04:33:17.367821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 373/749] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:17 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1508 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:17.692232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:17.692871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:17.698524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.698967 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:17.699749 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.700202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:17.822227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:17.829847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4d682365-d5a3-4de4-80d5-2f3d7b95ecc6 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.141815 Sep 02 04:33:17.831029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 377/750] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:17 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:17.861077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:17.862262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:17.867980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.868430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:17.869208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:17.869644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.003460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:18.004102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:18.010211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.010663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.011463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.011894 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.014936 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.026163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.028510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.030383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f707435f-a5a8-40ed-9af3-07ec6068ab3c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.172530 Sep 02 04:33:18.033004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 374/751] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:17 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:18.136818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.144535 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-af306749-9039-4f3e-a303-ac958a238fcf tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1514 microversion: 2.1 time: 0.144946 Sep 02 04:33:18.145110 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 378/752] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:17 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:18.382950 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:18.383564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:18.389653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.390090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.390843 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.391268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.566810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-480a2889-1bbd-493d-84e8-6cab550e3ecf req-37c45c13-facc-4f08-a7aa-9c32ee3e624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91f6e8-1260-4e45-afc2-e02c3250f91b", "name": "network-vif-deleted", "tag": "3c711505-4162-4e0a-af45-c6ecdc0466d0"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:18.568641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:18.568641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:33:18.575805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-480a2889-1bbd-493d-84e8-6cab550e3ecf req-37c45c13-facc-4f08-a7aa-9c32ee3e624b service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.576274 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-480a2889-1bbd-493d-84e8-6cab550e3ecf req-37c45c13-facc-4f08-a7aa-9c32ee3e624b service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.581234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.589667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-480a2889-1bbd-493d-84e8-6cab550e3ecf req-37c45c13-facc-4f08-a7aa-9c32ee3e624b service nova] Creating event network-vif-deleted:3c711505-4162-4e0a-af45-c6ecdc0466d0 for instance 7e91f6e8-1260-4e45-afc2-e02c3250f91b on hv-cinder-80473 Sep 02 04:33:18.594483 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-480a2889-1bbd-493d-84e8-6cab550e3ecf req-37c45c13-facc-4f08-a7aa-9c32ee3e624b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031580 Sep 02 04:33:18.595344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 379/753] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:18.598407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a6937ddf-b32a-4e68-b44f-e84d023075d7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1508 microversion: 2.1 time: 0.218905 Sep 02 04:33:18.599118 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 375/754] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:18 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:18.847928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:18.848558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:18.854759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.855247 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.856024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:18.856451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:18.980552 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:18.988599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d835406e-1e47-4402-ab65-791556e5e093 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.145373 Sep 02 04:33:18.989171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 380/755] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:18 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:19.049626 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:19.050242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:19.056026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.056568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.057331 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.057764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.170412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:19.171020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:19.177415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.178147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.179037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.179708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.180040 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:19.188362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:19.196312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:19.196312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7024ce9b-9adc-4c42-9d30-e43a215f0373 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.146341 Sep 02 04:33:19.196312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 376/756] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:19 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:19.211029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.211463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.211898 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lazy-loading 'fault' on Instance uuid 7e91f6e8-1260-4e45-afc2-e02c3250f91b {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:19.253363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05601393e5948458fd6e350520776c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c709f5c0524e4384bdb829d81c46c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:19.261796 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ab87e193-0166-4ce0-a13c-2fa220918e86 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 200 len: 1308 microversion: 2.1 time: 0.095075 Sep 02 04:33:19.262349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 381/757] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:19 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:19.615223 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:19.615876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:19.622480 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.622926 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.623732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:19.624224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:19.782218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:19.789355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-78009005-2208-4c9e-bde0-9afa2bdbdd0f tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1508 microversion: 2.1 time: 0.178719 Sep 02 04:33:19.789912 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 377/758] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:19 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:20.006064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:20.006678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:20.012539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.013292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.013820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.014257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.139543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:20.154324 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e9b16627-b5e8-4dc8-a134-c7e8e062badd tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.152296 Sep 02 04:33:20.154918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 382/759] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:20 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:20.196807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-6b1a81e0-8ef9-4f35-a775-dbe3b72f15e0 req-be38598b-dd5a-41f9-8f76-3491b8ce8183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "name": "network-vif-plugged", "status": "completed", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:20.198475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:20.198475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:33:20.205877 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6b1a81e0-8ef9-4f35-a775-dbe3b72f15e0 req-be38598b-dd5a-41f9-8f76-3491b8ce8183 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.206311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6b1a81e0-8ef9-4f35-a775-dbe3b72f15e0 req-be38598b-dd5a-41f9-8f76-3491b8ce8183 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.210145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:20.210760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:20.216571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.217018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.217652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-6b1a81e0-8ef9-4f35-a775-dbe3b72f15e0 req-be38598b-dd5a-41f9-8f76-3491b8ce8183 service nova] Creating event network-vif-plugged:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:33:20.217803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.218247 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.222593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-6b1a81e0-8ef9-4f35-a775-dbe3b72f15e0 req-be38598b-dd5a-41f9-8f76-3491b8ce8183 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029432 Sep 02 04:33:20.223171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 378/760] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:20.284419 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:20.285054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] [instance: 7e91f6e8-1260-4e45-afc2-e02c3250f91b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:20.291472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.291953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.292840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.293271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.312627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] HTTP exception thrown: Instance 7e91f6e8-1260-4e45-afc2-e02c3250f91b could not be found. Sep 02 04:33:20.313289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] Returning 404 to user: Instance 7e91f6e8-1260-4e45-afc2-e02c3250f91b could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:20.314199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-66dee8de-9851-4133-b48a-8d0ad1f9be70 tempest-AttachVolumeNegativeTest-1843848452 tempest-AttachVolumeNegativeTest-1843848452-project] 10.222.0.13 "GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b" status: 404 len: 111 microversion: 2.1 time: 0.039357 Sep 02 04:33:20.315517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 379/761] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:20 2021] GET /compute/v2.1/servers/7e91f6e8-1260-4e45-afc2-e02c3250f91b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:33:20.348542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:20.357774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:20.359316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:20.360616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b6be90e0-fd2f-45df-a5f4-d521e6dd5e88 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.154168 Sep 02 04:33:20.361176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 383/762] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:20 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:33:20.617347 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-9ffb8ca7-6b12-453b-b38c-e7613f304324 req-1a481b5c-c142-43b0-b0fd-920ae0db96bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2654621-5e63-4dfe-be2f-855ccb98065b", "name": "network-vif-deleted", "tag": "7fc32208-a98b-47a3-922d-4a33035bc09e"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:20.619099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:20.619099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:33:20.633216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9ffb8ca7-6b12-453b-b38c-e7613f304324 req-1a481b5c-c142-43b0-b0fd-920ae0db96bc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.633651 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9ffb8ca7-6b12-453b-b38c-e7613f304324 req-1a481b5c-c142-43b0-b0fd-920ae0db96bc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.646371 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-9ffb8ca7-6b12-453b-b38c-e7613f304324 req-1a481b5c-c142-43b0-b0fd-920ae0db96bc service nova] Creating event network-vif-deleted:7fc32208-a98b-47a3-922d-4a33035bc09e for instance c2654621-5e63-4dfe-be2f-855ccb98065b on hv-cinder-80473 Sep 02 04:33:20.651117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-9ffb8ca7-6b12-453b-b38c-e7613f304324 req-1a481b5c-c142-43b0-b0fd-920ae0db96bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037790 Sep 02 04:33:20.655717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 380/763] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:20.809584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:20.809584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:20.830887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.831391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.832552 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.833157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.871281 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:20.871725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:20.872204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lazy-loading 'fault' on Instance uuid c2654621-5e63-4dfe-be2f-855ccb98065b {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:20.912114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:20.919855 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f8cc82de-8e4d-4a62-a818-ee9703810468 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 200 len: 1312 microversion: 2.1 time: 0.117366 Sep 02 04:33:20.920440 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 384/764] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:20 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:21.171567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:21.172323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:21.178264 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.178710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.179475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.179931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.324880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:21.331861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dc77702c-5002-4a8c-bc76-854fcb9cec56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.164336 Sep 02 04:33:21.332572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 381/765] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:21 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:21.379041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:21.379581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:21.385379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.385820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.386572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.387029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.516170 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:21.525074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:21.526616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:21.527794 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-80503613-22ac-43d0-bd9f-94f3d6f97cb9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.153239 Sep 02 04:33:21.528407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 385/766] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:21 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:21.936991 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:21.937627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: c2654621-5e63-4dfe-be2f-855ccb98065b] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:21.943963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.944413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.945167 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.945599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.958472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] HTTP exception thrown: Instance c2654621-5e63-4dfe-be2f-855ccb98065b could not be found. Sep 02 04:33:21.959039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Returning 404 to user: Instance c2654621-5e63-4dfe-be2f-855ccb98065b could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:21.959841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fe627650-702b-4760-bd73-824ef7d151ce tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b" status: 404 len: 111 microversion: 2.1 time: 0.026549 Sep 02 04:33:21.960392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 382/767] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:21 2021] GET /compute/v2.1/servers/c2654621-5e63-4dfe-be2f-855ccb98065b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:33:21.968211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:21.968714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:21.974360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.980500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:21.980500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:21.980500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.000253 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:33:22.348968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:22.350411 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:22.356806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.357256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.363272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.363272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.393009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6d7ac552-879e-4cba-9a90-25780e4e60a0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 204 len: 0 microversion: 2.1 time: 0.428124 Sep 02 04:33:22.401803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 386/768] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:33:21 2021] DELETE /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:33:22.410733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:22.411427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:22.417398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.417839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.418589 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.419014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.505165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:22.513228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f1edefe0-4a1c-4d4c-bdce-404df21733c1 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.168404 Sep 02 04:33:22.517503 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 383/769] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:22 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:22.545670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:22.546277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:22.547204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:22.552418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.552853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.553611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:22.554240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:22.554780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d5fa02b5-543b-4cc8-b7ba-3a0ea9b1e4e7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.148478 Sep 02 04:33:22.555363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 387/770] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:22 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:22.675307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:22.683481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:22.685019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:22.686171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eabdf849-36d3-4fdd-a502-99166caac86d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.144185 Sep 02 04:33:22.686719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 384/771] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:22 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:23.238512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b013b571-8986-43e9-9e6b-c6156bd6c271 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Action: 'create', calling method: .version_select at 0x7fa04b37faf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2133651590", "metadata": {"Type": "work"}}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:23.530339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:23.530976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:23.536825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.537292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.538076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.538562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.660568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:23.668329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e84a9fda-eddc-4369-886c-0b4ef97a153b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.141585 Sep 02 04:33:23.668893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 385/772] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:23 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:23.673121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:23.673721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:23.679771 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.687627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.687627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.687627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.796700 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:23.804102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ea61c52d-53a7-47c0-8657-b94036262877 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.134230 Sep 02 04:33:23.804667 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 386/773] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:23 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:23.808887 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:23.809492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:23.815408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.815877 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.816660 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:23.817089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:23.937680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:23.946233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:23.947834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:23.949011 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a30cbbde-30ae-4d0d-8297-2382f5d90647 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.143439 Sep 02 04:33:23.949570 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 387/774] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:23 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:24.181489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b013b571-8986-43e9-9e6b-c6156bd6c271 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.047715 Sep 02 04:33:24.182121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 388/775] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Sep 2 04:33:23 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1049 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 04:33:24.192756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3a428aef-3925-40a0-a21d-8612464cadfa tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b385820>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:24.243825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3a428aef-3925-40a0-a21d-8612464cadfa tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 200 len: 353 microversion: 2.1 time: 0.054405 Sep 02 04:33:24.244417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 388/776] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:24 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:24.685980 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:24.686521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:24.692824 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.693270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:24.694025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.694452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:24.811829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:24.820681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:24.821180 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3f690f97-b6a6-492c-8d4f-9f3357d63949 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.138521 Sep 02 04:33:24.821280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:24.821368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 389/777] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:24 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:24.827014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.827451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:24.828222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.828650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:24.944302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:24.951720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-667dd0fb-fe50-4030-b870-77a41b02f1e3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.134579 Sep 02 04:33:24.952327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 389/778] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:24 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:24.966175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:24.966784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:24.972623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.973071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:24.973820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:24.974251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:25.094455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:25.103185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:25.104711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:25.105844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-97075e82-8bf4-46f7-a62a-26cf4ebdef4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.143322 Sep 02 04:33:25.106392 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 390/779] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:24 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:25.256072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-574d707c-2546-474d-8b3c-1258dd1feeea tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b2aa4c0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:25.308063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-574d707c-2546-474d-8b3c-1258dd1feeea tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 200 len: 353 microversion: 2.1 time: 0.055493 Sep 02 04:33:25.308628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 390/780] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:25 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:25.837130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:25.837671 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:25.843501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:25.843976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:25.844737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:25.850735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:25.965658 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:25.968487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:25.969168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:25.973407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e863f7f0-7173-483e-8bf3-8f10cba7df65 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.139976 Sep 02 04:33:25.973963 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 391/781] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:25 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:25.975730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:25.976290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:25.977112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:25.977661 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:26.095553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:26.103122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b9b3d481-67db-4344-b0cd-53efe6f35060 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.138366 Sep 02 04:33:26.103679 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 391/782] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:25 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:26.124145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.124965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:26.131311 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:26.131756 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:26.132534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:26.132966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:26.251303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:26.259463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:26.261024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:26.262200 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7c727e5d-2e96-410f-bf7e-28e83f1c27a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1808 microversion: 2.20 time: 0.141765 Sep 02 04:33:26.262760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 392/783] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:26 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:26.320825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-94af2f48-d9e2-462f-bc11-eb54b324aa94 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b407af0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.373161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-94af2f48-d9e2-462f-bc11-eb54b324aa94 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 200 len: 354 microversion: 2.1 time: 0.055840 Sep 02 04:33:26.373399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 392/784] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:26 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:26.385637 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-52fc7ebc-128b-4970-b1d9-e6f498b2b3ae tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b35a790>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.438241 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-52fc7ebc-128b-4970-b1d9-e6f498b2b3ae tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 200 len: 354 microversion: 2.1 time: 0.056155 Sep 02 04:33:26.438805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 393/785] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:26 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:26.455214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-12fea772-a186-431e-80d2-cee9e6183015 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b385430>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.795462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-12fea772-a186-431e-80d2-cee9e6183015 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 202 len: 0 microversion: 2.1 time: 0.344220 Sep 02 04:33:26.796327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 393/786] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:33:26 2021] DELETE /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:33:26.805214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2ba807a4-b7b1-40a6-9bfb-e6d4ae8591ea tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b35aca0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.857487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2ba807a4-b7b1-40a6-9bfb-e6d4ae8591ea tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 200 len: 353 microversion: 2.1 time: 0.056245 Sep 02 04:33:26.858054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 394/787] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:26 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:26.990380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:26.991009 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:26.997283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:26.997724 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:26.998470 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:26.998893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:27.119956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:27.120607 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:27.127825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:27.128371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:27.128558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:27.129307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:27.129818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:27.136632 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4d24a787-0cbe-4277-b112-acf3729379b2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.150523 Sep 02 04:33:27.137201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 394/788] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:26 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:27.254610 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:27.262903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-34f82f24-51a9-4460-b97b-77b752aefd4a tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.147067 Sep 02 04:33:27.263937 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 395/789] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:27 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:27.281051 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:27.281652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:27.287619 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:27.288103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:27.288854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:27.289281 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:27.406007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:27.414999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:27.416580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:27.417756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cf081383-20c6-43cb-9b53-6bad33b1c227 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1795 microversion: 2.20 time: 0.140630 Sep 02 04:33:27.418307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 395/790] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:33:27 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1795 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:33:27.869770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-97ab8fe8-20de-4716-992f-b8b7ec7af344 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Calling method '.version_select at 0x7fa04b37fc10>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:27.896005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-97ab8fe8-20de-4716-992f-b8b7ec7af344 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] HTTP exception thrown: Volume 49bc56f1-c86d-4aed-bd00-457fc672a7bc could not be found. Sep 02 04:33:27.896590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-97ab8fe8-20de-4716-992f-b8b7ec7af344 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] Returning 404 to user: Volume 49bc56f1-c86d-4aed-bd00-457fc672a7bc could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:27.897389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-97ab8fe8-20de-4716-992f-b8b7ec7af344 tempest-VolumesGetTestJSON-962226846 tempest-VolumesGetTestJSON-962226846-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc" status: 404 len: 109 microversion: 2.1 time: 0.031305 Sep 02 04:33:27.897899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 396/791] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Sep 2 04:33:27 2021] GET /compute/v2.1/os-volumes/49bc56f1-c86d-4aed-bd00-457fc672a7bc => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:33:28.153857 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:28.154423 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:28.160145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:28.160628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:28.161364 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:28.161790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:28.284194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:28.285078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:28.296732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:28.298744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:28.299389 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:28.300200 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:28.301002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:28.305348 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1ee6ab25-ef38-4f44-9d4d-76bd77f2f014 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.155213 Sep 02 04:33:28.306355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 396/792] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:28 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:28.419626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:28.426883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-746a68cd-fa6b-46c0-a456-bb74d19ec8a5 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.149780 Sep 02 04:33:28.427436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 397/793] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:28 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:29.322327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:29.322939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:29.329270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:29.329714 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:29.331208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:29.331742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:29.443420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:29.444064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:29.450049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:29.450521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:29.451315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:29.451746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:29.460718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:29.472104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-87083298-9287-4d38-84c0-34380f5816e5 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.153343 Sep 02 04:33:29.472990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 397/794] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:29 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:29.576356 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:29.584175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ded28bf5-fd60-49ec-bc28-67e549df1f4c tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.144426 Sep 02 04:33:29.584742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 398/795] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:29 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:30.489970 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:30.490576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:30.496547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:30.496984 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:30.497733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:30.498339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:30.601487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:30.612136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:30.612136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:30.612136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:30.612136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:30.612666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:30.644748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:30.652747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6fb4f73e-3a60-4660-832f-b8ab1aa6e00b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.166998 Sep 02 04:33:30.653326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 398/796] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:30 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:30.733632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:30.741491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-41984dc2-9a32-47f7-a679-9384757d4a49 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.143968 Sep 02 04:33:30.742060 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 399/797] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:30 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:31.437749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:31.438380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:31.444527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.444972 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.445759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.446172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.532783 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lazy-loading 'services' on Instance uuid a1fdfd22-1160-4f16-ad90-ec2fd5150229 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:31.678448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:31.679054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:31.684820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.685262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.686039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.686469 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.808619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:31.817509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8c385598-91e1-47de-b8a3-a04a2f55d671 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.142629 Sep 02 04:33:31.818838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 400/798] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:31 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:31.822690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:31.823290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:31.828854 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.829295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.830045 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:31.830474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:31.955286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:31.961715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-06f7c60b-dc9d-41ee-8f55-534e9989c4a3 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1521 microversion: 2.1 time: 0.142285 Sep 02 04:33:31.962370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 401/799] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:31 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:31.996523 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8daa88e7-4a16-4c80-9efc-a34bba1585e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments/cffb85c9-6185-46a0-b4c7-1b2542285d3f" status: 202 len: 0 microversion: 2.1 time: 0.562270 Sep 02 04:33:32.000865 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 399/800] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:33:31 2021] DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments/cffb85c9-6185-46a0-b4c7-1b2542285d3f => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:33:32.492345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-93a364e2-5211-4a6f-a43f-967569077be8 req-c4dd1ec7-7a16-46e2-ab02-d5dcf922cd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffde743-fe81-4cab-9344-57ca521c59f4", "name": "network-vif-deleted", "tag": "3146d225-6bdc-4864-a93a-c0e1301bc12c"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:32.494035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:32.494035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:33:32.500740 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-93a364e2-5211-4a6f-a43f-967569077be8 req-c4dd1ec7-7a16-46e2-ab02-d5dcf922cd5b service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:32.501176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-93a364e2-5211-4a6f-a43f-967569077be8 req-c4dd1ec7-7a16-46e2-ab02-d5dcf922cd5b service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:32.512407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-93a364e2-5211-4a6f-a43f-967569077be8 req-c4dd1ec7-7a16-46e2-ab02-d5dcf922cd5b service nova] Creating event network-vif-deleted:3146d225-6bdc-4864-a93a-c0e1301bc12c for instance 3ffde743-fe81-4cab-9344-57ca521c59f4 on hv-cinder-80473 Sep 02 04:33:32.519167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-93a364e2-5211-4a6f-a43f-967569077be8 req-c4dd1ec7-7a16-46e2-ab02-d5dcf922cd5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028970 Sep 02 04:33:32.519167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 402/801] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:32.834255 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:32.834977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:32.840918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:32.851060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:32.851060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:32.851060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:32.979624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:32.980348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:32.987316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:32.987771 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:32.988573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:32.989028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:33.051680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:33.059402 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a342b703-53ea-4fee-913f-e523cf883bf7 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1479 microversion: 2.1 time: 0.084055 Sep 02 04:33:33.060027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 403/802] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:32 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1479 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:33.250530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:33.258364 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0c79b42e-72dc-4a68-a9c5-8fc6216b84a9 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.428236 Sep 02 04:33:33.258934 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 400/803] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:32 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:34.076991 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:34.078294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:34.084806 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:34.085246 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:34.086006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:34.086434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:34.151353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:34.158883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-953c92bc-ddb2-42ac-85fe-d2d44661e1f0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1479 microversion: 2.1 time: 0.086652 Sep 02 04:33:34.159834 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 404/804] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:34 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:34.274655 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:34.275257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:34.281084 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:34.281528 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:34.282279 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:34.282706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:34.418562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:34.426526 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b6d18244-ad05-4540-891d-96716eaba0dc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.155499 Sep 02 04:33:34.427350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 401/805] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:34 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:35.175596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:35.176286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:35.182163 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:35.182598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:35.183347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:35.183772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:35.271413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96ae12c709e468490680328fc553b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f3fc4797ec410b8f3fb46fc7409fe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:35.271851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4c9b609e-8792-43e4-9788-0214f9dfa0b0 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 200 len: 1307 microversion: 2.1 time: 0.099940 Sep 02 04:33:35.272432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 405/806] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:35 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:35.443136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:35.443741 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:35.450002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:35.450506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:35.451209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:35.451636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:35.572894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:35.580531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e9af9df5-c2d5-4d3c-b76d-20056bf3d82e tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1753 microversion: 2.1 time: 0.141736 Sep 02 04:33:35.581108 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 402/807] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:35 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1753 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:36.290530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:36.301165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] [instance: 3ffde743-fe81-4cab-9344-57ca521c59f4] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:36.301165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.301165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.301165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.302328 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.315641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] HTTP exception thrown: Instance 3ffde743-fe81-4cab-9344-57ca521c59f4 could not be found. Sep 02 04:33:36.316264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] Returning 404 to user: Instance 3ffde743-fe81-4cab-9344-57ca521c59f4 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:36.317079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d24396d3-f56a-4b61-b450-a90c380f3904 tempest-ServerRescueNegativeTestJSON-2132628194 tempest-ServerRescueNegativeTestJSON-2132628194-project] 10.222.0.13 "GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4" status: 404 len: 111 microversion: 2.1 time: 0.031357 Sep 02 04:33:36.317737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 406/808] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:36 2021] GET /compute/v2.1/servers/3ffde743-fe81-4cab-9344-57ca521c59f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:33:36.321487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-50cf5f2b-7e56-4a39-97f0-95f7929f5eef tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:36.327482 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50cf5f2b-7e56-4a39-97f0-95f7929f5eef tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.327957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50cf5f2b-7e56-4a39-97f0-95f7929f5eef tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.391537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-50cf5f2b-7e56-4a39-97f0-95f7929f5eef tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Going to try to stop instance {{(pid=108891) force_stop /opt/stack/nova/nova/compute/api.py:2651}} Sep 02 04:33:36.584171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-50cf5f2b-7e56-4a39-97f0-95f7929f5eef tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 202 len: 0 microversion: 2.1 time: 0.266491 Sep 02 04:33:36.584921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 403/809] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:33:36 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:33:36.593359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:36.595857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:36.602570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.603065 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.603311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:36.604030 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.604159 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:36.604545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.610325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.610767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.611850 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:36.612309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:36.730104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:36.738013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8a8415c9-a1f9-4e24-8f10-3e301e509753 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.148600 Sep 02 04:33:36.738567 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 407/810] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:36 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:36.819489 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:36.829343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dd20053e-1d98-4cdd-afe5-ecdc20fcf352 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1756 microversion: 2.1 time: 0.234413 Sep 02 04:33:36.844438 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 404/811] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:36 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1756 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:37.755368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:37.755982 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:37.762129 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:37.762556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:37.763309 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:37.763939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:37.888783 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:37.896747 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f8155404-9eb2-40f8-9620-4a5b1904a5bb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.145341 Sep 02 04:33:37.897319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 408/812] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:37 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:38.913163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:38.913843 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:38.919620 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:38.920126 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:38.920996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:38.921317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:39.223437 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:39.230273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:39.230847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:39.233965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a1387b24-38d2-4dcc-b3b4-49962281f365 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.324097 Sep 02 04:33:39.234735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 405/813] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:38 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:39.245998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:39.246442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:39.247206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:39.247634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:39.345797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lazy-loading 'services' on Instance uuid 6512480e-2b4a-48b0-b6d9-1183746b3624 {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:39.630761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2c91c194-3cd0-4ed4-bac9-a8fed71fff55 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624/os-volume_attachments/3fd4636e-c2ef-4759-bded-1fc52009b570" status: 202 len: 0 microversion: 2.1 time: 0.404279 Sep 02 04:33:39.631412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 409/814] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:33:39 2021] DELETE /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624/os-volume_attachments/3fd4636e-c2ef-4759-bded-1fc52009b570 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:33:40.252719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:40.253356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:40.259159 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:40.259627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:40.260435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:40.260859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:40.411412 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:40.419098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2f22a817-8dac-410c-8b8f-904a6cd69a7e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.170371 Sep 02 04:33:40.419683 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 406/815] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:40 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:41.435630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:41.436367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:41.442395 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:41.442836 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:41.443599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:41.444067 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:41.573906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:41.582194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-41a03d39-a205-4d5e-bd91-2790e2c4d0af tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.150571 Sep 02 04:33:41.583161 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 410/816] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:41 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:41.816552 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:41.817163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:41.823177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:41.823627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:41.824408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:41.824830 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:41.849883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:33:42.184089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-65603f13-1474-4031-baee-c03332f019cc tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 204 len: 0 microversion: 2.1 time: 0.371515 Sep 02 04:33:42.184676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 407/817] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:33:41 2021] DELETE /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:33:42.193369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:42.193978 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:42.199557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:42.200046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:42.200812 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:42.201243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:42.324102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:42.331378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-98644a18-6110-4a2d-a8b3-4bb4b6384cfe tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1512 microversion: 2.1 time: 0.142331 Sep 02 04:33:42.331990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 411/818] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:42 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:42.600686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:42.601404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:42.607636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:42.608104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:42.608853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:42.609273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:42.753477 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:42.762216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-90bdd02a-4823-4425-9004-d9635c138ffc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.165736 Sep 02 04:33:42.763367 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 408/819] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:42 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:43.348086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:43.348736 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:43.363732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:43.363732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:43.363732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:43.363732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:43.477903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:43.490541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f1651a3f-42d0-40f3-b503-7d9b24a8e6f1 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1512 microversion: 2.1 time: 0.141528 Sep 02 04:33:43.490541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 412/820] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:43 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1512 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:43.779928 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:43.780556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:43.786924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:43.787365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:43.789476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:43.789476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:43.945303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:43.945303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e9310463-61c6-4ae2-9add-beb5afb9f25a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.141044 Sep 02 04:33:43.945303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 409/821] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:43 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:44.508417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:44.509039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:44.514689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:44.515132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:44.515883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:44.516334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:44.636916 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:44.645034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d1cace12-4997-4f88-99c1-fde5f4f0b0de tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1512 microversion: 2.1 time: 0.140294 Sep 02 04:33:44.645614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 413/822] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:44 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:44.896659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-59c61eba-f7b1-4405-80cd-657579db069d req-91500836-34af-4d75-b83a-909c277c7b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6512480e-2b4a-48b0-b6d9-1183746b3624", "name": "network-vif-deleted", "tag": "a525487b-12c0-45f3-b6ca-68106090802b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:44.898097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:33:44.898097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:33:44.906828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-59c61eba-f7b1-4405-80cd-657579db069d req-91500836-34af-4d75-b83a-909c277c7b35 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:44.907648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-59c61eba-f7b1-4405-80cd-657579db069d req-91500836-34af-4d75-b83a-909c277c7b35 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:44.921304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-59c61eba-f7b1-4405-80cd-657579db069d req-91500836-34af-4d75-b83a-909c277c7b35 service nova] Creating event network-vif-deleted:a525487b-12c0-45f3-b6ca-68106090802b for instance 6512480e-2b4a-48b0-b6d9-1183746b3624 on hv-cinder-80473 Sep 02 04:33:44.926303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-59c61eba-f7b1-4405-80cd-657579db069d req-91500836-34af-4d75-b83a-909c277c7b35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033860 Sep 02 04:33:44.926900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 410/823] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:33:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:33:44.958543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:44.959144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:44.965101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:44.965543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:44.966294 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:44.966726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:45.085961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:45.093330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9801187b-86b5-4de7-912a-a3fffd6fa6e0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.138855 Sep 02 04:33:45.093888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 414/824] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:44 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:45.662270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:45.663003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:45.669193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:45.669628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:45.670376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:45.670798 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:45.702283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:45.702717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:45.703185 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lazy-loading 'fault' on Instance uuid 6512480e-2b4a-48b0-b6d9-1183746b3624 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:33:45.743885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:45.751993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9d9c3377-6080-4be9-ac2f-09fdddb831e0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 200 len: 1308 microversion: 2.1 time: 0.093019 Sep 02 04:33:45.752675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 411/825] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:45 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:46.111364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:46.112040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:46.118316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:46.118751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:46.119515 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:46.119993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:46.248303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:46.261479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-945004a5-5208-4185-9d3b-a63e74b9cb54 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1675 microversion: 2.1 time: 0.154640 Sep 02 04:33:46.262015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 415/826] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:46 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:46.771713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:46.772455 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 6512480e-2b4a-48b0-b6d9-1183746b3624] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:46.778275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:46.778715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:46.779462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:46.779896 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:46.793776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] HTTP exception thrown: Instance 6512480e-2b4a-48b0-b6d9-1183746b3624 could not be found. Sep 02 04:33:46.794350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Returning 404 to user: Instance 6512480e-2b4a-48b0-b6d9-1183746b3624 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:33:46.795155 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-486dd708-c354-4476-b16a-6a94ceb3f3df tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624" status: 404 len: 111 microversion: 2.1 time: 0.027295 Sep 02 04:33:46.795679 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 412/827] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:46 2021] GET /compute/v2.1/servers/6512480e-2b4a-48b0-b6d9-1183746b3624 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:33:47.278943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:47.279503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:47.286017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:47.286903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:47.287715 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:47.288207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:47.427439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:47.434903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3a0fc929-395c-444e-9ea9-749dc9a2d213 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1652 microversion: 2.1 time: 0.159880 Sep 02 04:33:47.435481 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 416/828] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:47 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:47.452103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f6301870-e20e-46a8-b396-7944ef73805b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:47.458232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f6301870-e20e-46a8-b396-7944ef73805b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:47.458871 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f6301870-e20e-46a8-b396-7944ef73805b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:47.481957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f6301870-e20e-46a8-b396-7944ef73805b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Going to try to start instance {{(pid=108891) start /opt/stack/nova/nova/compute/api.py:2674}} Sep 02 04:33:47.738146 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f6301870-e20e-46a8-b396-7944ef73805b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action" status: 202 len: 0 microversion: 2.1 time: 0.289608 Sep 02 04:33:47.738746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 413/829] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:33:47 2021] POST /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:33:47.746543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:47.747229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:47.752984 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:47.753427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:47.754175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:47.754598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:47.877561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:47.884698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4cb45a91-b545-487a-8e8c-437404516b46 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1661 microversion: 2.1 time: 0.141780 Sep 02 04:33:47.885260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 417/830] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:47 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1661 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:48.902934 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:48.904288 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:48.912401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:48.913179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:48.914410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:48.915561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:49.043147 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:49.051273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2bdc894c-1a5d-406e-b9fc-5571b10f5f7b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1661 microversion: 2.1 time: 0.152289 Sep 02 04:33:49.051854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 414/831] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:48 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:33:50.068660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:50.069267 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:50.074840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:50.075279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:50.076049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:50.076476 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:50.201837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:50.209724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8d850f50-4bec-4619-bf19-1d0972516601 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1661 microversion: 2.1 time: 0.144616 Sep 02 04:33:50.210316 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 418/832] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:50 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1661 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:51.226484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:51.227098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:51.232866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:51.233308 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:51.234089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:51.234585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:51.369135 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:51.376769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ec2b7cba-4457-4096-976b-821358012716 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1661 microversion: 2.1 time: 0.153995 Sep 02 04:33:51.377180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 415/833] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:51 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:52.393429 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:52.394052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:52.399876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:52.400364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:52.401137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:52.401571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:52.530473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:52.538317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6626374b-b481-402a-966d-cb3b8809ccbc tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1665 microversion: 2.1 time: 0.149269 Sep 02 04:33:52.538882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 419/834] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:52 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:57.397217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1079852791", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "36934402-f060-463c-a58a-2b7056c383b5"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:33:57.448811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] validate_networks() for [('36934402-f060-463c-a58a-2b7056c383b5', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:33:57.790210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:33:57.790621 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:33:57.791084 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:33:57.791502 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:33:57.791922 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:33:57.800612 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:57.801050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:57.801838 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:57.802257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:57.819250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Getting quotas for project 575695d7181e435fb176d616cafa196c. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:33:57.823095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Getting quotas for user 7fa8d7424a374b0faa2b31eda4ef711b and project 575695d7181e435fb176d616cafa196c. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:33:57.834126 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:33:57.836446 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:33:57.942459 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8f4c89c0-9180-47f3-845f-ff81690fc38d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548949 Sep 02 04:33:57.943034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 416/835] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:33:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:33:57.952657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6fa71c90-87b2-4d68-b69c-dd7f39019873 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:57.953281 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6fa71c90-87b2-4d68-b69c-dd7f39019873 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:58.004930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6fa71c90-87b2-4d68-b69c-dd7f39019873 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:58.011753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6fa71c90-87b2-4d68-b69c-dd7f39019873 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1219 microversion: 2.1 time: 0.062862 Sep 02 04:33:58.012370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 420/836] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:57 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:33:59.028710 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:33:59.029442 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:33:59.036299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:59.036755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:59.037496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:33:59.037921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:33:59.105244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:33:59.113387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-30001d16-33c9-48b0-98c7-dcb6fae39915 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1223 microversion: 2.1 time: 0.088445 Sep 02 04:33:59.113890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 417/837] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:33:59 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:00.131220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:00.132005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:00.137904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:00.138547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:00.139483 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:00.139925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:00.214029 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:00.222138 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9c9aa507-0306-4158-9a29-29daaf196b0e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1279 microversion: 2.1 time: 0.094879 Sep 02 04:34:00.222708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 421/838] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:00 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:01.239799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:01.240487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:01.247546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:01.248030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:01.248798 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:01.249230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:01.466933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:01.475558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-343feebf-3322-4b19-a5f8-8161f312e689 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.240719 Sep 02 04:34:01.476300 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 418/839] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:01 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:02.215307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-41f68acd-c4f3-498e-910c-b55f0363f1d9 req-192c5131-48a8-4e05-945c-cbac306f07e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95674748-4b1b-4dbb-98d6-fb5403a9d5ca", "tag": "26a563ab-3b33-425b-adb7-b73da80f7062"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:02.218202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:02.218202 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:02.230039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-41f68acd-c4f3-498e-910c-b55f0363f1d9 req-192c5131-48a8-4e05-945c-cbac306f07e0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:02.238502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-41f68acd-c4f3-498e-910c-b55f0363f1d9 req-192c5131-48a8-4e05-945c-cbac306f07e0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:02.250975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-41f68acd-c4f3-498e-910c-b55f0363f1d9 req-192c5131-48a8-4e05-945c-cbac306f07e0 service nova] Creating event network-changed:26a563ab-3b33-425b-adb7-b73da80f7062 for instance 95674748-4b1b-4dbb-98d6-fb5403a9d5ca on hv-cinder-80473 Sep 02 04:34:02.256593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-41f68acd-c4f3-498e-910c-b55f0363f1d9 req-192c5131-48a8-4e05-945c-cbac306f07e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046490 Sep 02 04:34:02.257209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 422/840] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:34:02.502380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:02.503798 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:02.510759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:02.511470 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:02.512475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:02.513110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:02.670921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:02.679703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8ff4bde7-337f-45c7-9223-ca5a22d36181 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.181048 Sep 02 04:34:02.680335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 419/841] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:02 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:03.697366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:03.700339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:03.704702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:03.705148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:03.706398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:03.706850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:03.829386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:03.837116 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-087477af-96bd-4668-bc80-66ea95f9684f tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.144267 Sep 02 04:34:03.837676 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 423/842] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:03 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:04.854174 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:04.854819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:04.860592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:04.861028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:04.861776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:04.862838 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:04.990435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:04.997834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c6faa86b-a40f-4559-9960-6a982db2f01e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.147741 Sep 02 04:34:04.998511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 420/843] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:04 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:06.014327 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:06.015160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:06.021512 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:06.021861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:06.022641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:06.023071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:06.147480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:06.154646 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ea313a45-3313-427d-9430-05e4b2bed8f7 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.143971 Sep 02 04:34:06.155204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 424/844] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:06 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:07.170993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:07.171598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:07.180207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:07.180207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:07.180207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:07.180207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:07.366290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:07.373839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-03d26d52-ded7-4c78-a308-cf9075517ce2 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.206638 Sep 02 04:34:07.374416 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 421/845] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:07 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:07.449761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-90f3ffbd-c529-41b2-8cb0-343884e7f84e req-ee9d71ae-6b02-4517-9145-6b17312ed236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95674748-4b1b-4dbb-98d6-fb5403a9d5ca", "name": "network-vif-plugged", "status": "completed", "tag": "26a563ab-3b33-425b-adb7-b73da80f7062"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:07.451293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:07.451293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:07.458245 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-90f3ffbd-c529-41b2-8cb0-343884e7f84e req-ee9d71ae-6b02-4517-9145-6b17312ed236 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:07.458680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-90f3ffbd-c529-41b2-8cb0-343884e7f84e req-ee9d71ae-6b02-4517-9145-6b17312ed236 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:07.469393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-90f3ffbd-c529-41b2-8cb0-343884e7f84e req-ee9d71ae-6b02-4517-9145-6b17312ed236 service nova] Creating event network-vif-plugged:26a563ab-3b33-425b-adb7-b73da80f7062 for instance 95674748-4b1b-4dbb-98d6-fb5403a9d5ca on hv-cinder-80473 Sep 02 04:34:07.474954 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-90f3ffbd-c529-41b2-8cb0-343884e7f84e req-ee9d71ae-6b02-4517-9145-6b17312ed236 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038787 Sep 02 04:34:07.475546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 425/846] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:08.391242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:08.391851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:08.398226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:08.398672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:08.399443 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:08.399868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:08.520495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:08.528855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2aa4f062-f727-4b7e-b030-c51bd5c64839 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1319 microversion: 2.1 time: 0.140374 Sep 02 04:34:08.528855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 422/847] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:08 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:09.503003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:09.505431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:09.513910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.514370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.515276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.515711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.544258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:09.544861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:09.545708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7dfff311-1f3e-4b08-a1d0-20bff14c55b5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments/752c0e77-689a-4b2c-936b-2a87ae4afa57" status: 200 len: 194 microversion: 2.20 time: 0.046843 Sep 02 04:34:09.546313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 426/848] 10.222.0.13 () {60 vars in 1454 bytes} [Thu Sep 2 04:34:09 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments/752c0e77-689a-4b2c-936b-2a87ae4afa57 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:34:09.551019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.551717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.552495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.552921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.618507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:09.618507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:09.620166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.620803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.621584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.622019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.683539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:09.691119 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-421ccf32-866b-45cd-b251-8a5f7a6308c4 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1507 microversion: 2.1 time: 0.150497 Sep 02 04:34:09.692165 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 423/849] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:09 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:09.709181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b0eb18f-3d80-4340-a57e-4aed2c495737", "device": "/dev/sdb"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:09.711309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:09.714256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'services' on Instance uuid 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:09.718216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.718654 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:09.719613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:09.720067 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:10.023660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-daff6a29-740f-4136-beee-b7b8ce61dfbe tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments/752c0e77-689a-4b2c-936b-2a87ae4afa57" status: 202 len: 0 microversion: 2.20 time: 0.414520 Sep 02 04:34:10.027155 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 427/850] 10.222.0.13 () {60 vars in 1457 bytes} [Thu Sep 2 04:34:09 2021] DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments/752c0e77-689a-4b2c-936b-2a87ae4afa57 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:34:10.032961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:10.036333 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:10.040258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:10.040703 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:10.041692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:10.041993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:10.071233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d33a791c-ac73-473b-9cb5-909a6d3eada2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042536 Sep 02 04:34:10.071790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 428/851] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:34:10 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:34:11.082882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:11.083780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:11.089333 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:11.089777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:11.090525 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:11.090949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:11.125369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b2667e75-5275-48fb-86ee-8288b871ef7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041519 Sep 02 04:34:11.125369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 429/852] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:34:11 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:34:12.134177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:12.135091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:12.140957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:12.141404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:12.142156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:12.142586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:12.170626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8ebb8002-1d3a-4e40-8d87-8cc86b4d528f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040173 Sep 02 04:34:12.171161 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 430/853] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:34:12 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:34:13.063738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-95c8e5c7-9f14-4e94-98ec-10e88859b3da tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "POST /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.360092 Sep 02 04:34:13.064461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 424/854] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:34:09 2021] POST /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca/os-volume_attachments => generated 194 bytes in 3362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:13.185326 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:13.185326 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:13.189385 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:13.189833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:13.190596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:13.191025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:13.219973 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3a09e084-808e-40b1-a473-9a0964e636b1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041306 Sep 02 04:34:13.220529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 431/855] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:34:13 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:34:14.232895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:14.234638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:14.240562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.241004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.241764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.242191 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.272497 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f348dec2-527a-4956-826b-9cdf2dae6031 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044271 Sep 02 04:34:14.273074 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 425/856] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:34:14 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:14.338501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:14.339172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:14.345111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.345551 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.346311 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.346743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.371521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:34:14.769028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c08433ad-5729-4f30-8f97-422c660370a6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 204 len: 0 microversion: 2.20 time: 0.434030 Sep 02 04:34:14.770387 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 432/857] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Sep 2 04:34:14 2021] DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 04:34:14.778218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:14.790695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:14.790695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.790695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.790695 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:14.791103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:14.905575 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:14.914112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:14.915614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:14.916966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fdad3967-890a-4ee9-88d2-855617312229 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.142426 Sep 02 04:34:14.917532 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 426/858] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:14 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:34:15.936453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:15.937126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:15.943586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:15.944059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:15.944805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:15.945230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:16.092191 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:16.100314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:16.101802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:16.103043 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-844390d2-8974-4df1-a57a-d8ce30bdcfc5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.170795 Sep 02 04:34:16.103871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 433/859] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:15 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:17.121492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:17.122037 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:17.128258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:17.128698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:17.129487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:17.129914 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:17.322320 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:17.329976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:17.331488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:17.332667 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9fc75b23-281a-4f67-871c-5fa66d2972b2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1723 microversion: 2.20 time: 0.214945 Sep 02 04:34:17.333229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 427/860] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:17 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:17.856102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-fc22c4dc-26fc-44f5-8791-2ae3a7b5c2b6 req-7315b1c8-df3d-48ac-8afb-5cf11ad75bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9", "name": "network-vif-deleted", "tag": "acb5a59c-de5c-43dc-8bd2-1772919298ff"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:17.857707 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:17.857707 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:17.865304 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-fc22c4dc-26fc-44f5-8791-2ae3a7b5c2b6 req-7315b1c8-df3d-48ac-8afb-5cf11ad75bfb service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:17.865953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-fc22c4dc-26fc-44f5-8791-2ae3a7b5c2b6 req-7315b1c8-df3d-48ac-8afb-5cf11ad75bfb service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:17.878458 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-fc22c4dc-26fc-44f5-8791-2ae3a7b5c2b6 req-7315b1c8-df3d-48ac-8afb-5cf11ad75bfb service nova] Creating event network-vif-deleted:acb5a59c-de5c-43dc-8bd2-1772919298ff for instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 on hv-cinder-80473 Sep 02 04:34:17.884325 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-fc22c4dc-26fc-44f5-8791-2ae3a7b5c2b6 req-7315b1c8-df3d-48ac-8afb-5cf11ad75bfb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Sep 02 04:34:17.885480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 434/861] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:18.351825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:18.352464 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:18.361004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:18.364005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:18.364994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:18.365738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:18.420240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:18.420240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:18.420240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'fault' on Instance uuid 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:18.476128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:18.484785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:18.497802 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:18.500805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-392a0e38-9cda-4385-8f67-647aefb54641 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 200 len: 1369 microversion: 2.20 time: 0.151825 Sep 02 04:34:18.500805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 428/862] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:18 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:19.520907 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:19.521608 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:19.528906 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:19.529690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:19.530778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:19.531414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:19.546051 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. Sep 02 04:34:19.546939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:34:19.548095 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1879a44f-7579-4829-8759-5423c68921a9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 404 len: 111 microversion: 2.20 time: 0.032988 Sep 02 04:34:19.549147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 435/863] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:19 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:34:19.558803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-24a60684-f2cf-4fc1-8250-307fe9f8ec10 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '.version_select at 0x7fa04b226f70>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:19.700937 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-24a60684-f2cf-4fc1-8250-307fe9f8ec10 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10575427" status: 204 len: 0 microversion: 2.20 time: 0.147079 Sep 02 04:34:19.705213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 429/864] 10.222.0.13 () {60 vars in 1256 bytes} [Thu Sep 2 04:34:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10575427 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 04:34:20.681599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: .version_select at 0x7fa04b37fe50>, body: {"keypair": {"name": "tempest-keypair-308117454"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:20.686494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 04:34:20.701544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:20.705397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:21.088877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:21.092430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:21.105371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-30216773-66d8-415b-a397-f7b0b3ee3282 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.427457 Sep 02 04:34:21.105965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 436/865] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Sep 2 04:34:20 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 429 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Sep 02 04:34:23.532662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1442673000", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46143dd2-0d1f-423e-b171-0ee837e54bfa"}], "security_groups": [{"name": "tempest-securitygroup--280039807"}], "key_name": "tempest-keypair-308117454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:23.624408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] validate_networks() for [('46143dd2-0d1f-423e-b171-0ee837e54bfa', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:34:23.982426 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:34:23.982839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:34:23.983303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:34:23.983732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:34:23.984173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:34:23.992540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:23.992977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:23.993761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:23.994192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:24.010049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for project 0931655f059d4af598f60bd195366b84. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:24.013826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Getting quotas for user 43c1c2ebcbbc4abfa39cb2ce4d29f5b0 and project 0931655f059d4af598f60bd195366b84. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:24.024953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:34:24.027209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:34:24.153152 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-892dd99b-b599-4def-bd15-bc64c89e1aab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.624907 Sep 02 04:34:24.153715 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 430/866] 10.222.0.13 () {62 vars in 1188 bytes} [Thu Sep 2 04:34:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 04:34:24.174748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:24.175459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:24.185600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44286. Sep 02 04:34:24.230288 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:24.237938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:24.243683 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:24.244859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1b6757d6-ec74-4375-ba9a-1b861a4fe25d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1281 microversion: 2.20 time: 0.084785 Sep 02 04:34:24.245417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 437/867] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:24 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:25.240915 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-216052324"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:25.241454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:25.247845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:25.248341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:25.249331 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:25.249745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:25.261893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:25.266559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:25.270753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:25.271205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:25.272013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:25.272445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:25.341808 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:25.351426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:25.353132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:25.354243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ce1c954c-1763-4039-a7ab-25c9344a4ce2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1277 microversion: 2.20 time: 0.096131 Sep 02 04:34:25.355013 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 438/868] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:25 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:25.382329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.network.security_group_api [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Removing security group 670f3a52-44a8-4aaf-8467-f2f14f2921db from port c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 Sep 02 04:34:25.846397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3c7ac700-216c-4458-8b80-472fd84b93cc tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action" status: 202 len: 0 microversion: 2.1 time: 0.609036 Sep 02 04:34:25.851122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 431/869] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:34:25 2021] POST /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:34:25.855761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-c41c8dc3-b301-4e95-89e8-e57af7fa6c62 req-fa1d421e-892d-43f2-a1ee-df29e54e4e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:25.857782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:25.857782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:25.873036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-c41c8dc3-b301-4e95-89e8-e57af7fa6c62 req-fa1d421e-892d-43f2-a1ee-df29e54e4e14 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:25.873548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-c41c8dc3-b301-4e95-89e8-e57af7fa6c62 req-fa1d421e-892d-43f2-a1ee-df29e54e4e14 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:25.890227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-c41c8dc3-b301-4e95-89e8-e57af7fa6c62 req-fa1d421e-892d-43f2-a1ee-df29e54e4e14 service nova] Creating event network-changed:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:34:25.895392 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-c41c8dc3-b301-4e95-89e8-e57af7fa6c62 req-fa1d421e-892d-43f2-a1ee-df29e54e4e14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043966 Sep 02 04:34:25.896925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 439/870] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 02 04:34:26.372979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:26.374140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:26.381841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:26.382529 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:26.384088 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:26.384677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:26.762413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:26.774577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:26.783434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:26.783434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a225a5d1-cf39-471a-8bf3-29e72c55e639 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1341 microversion: 2.20 time: 0.409778 Sep 02 04:34:26.783434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 432/871] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:26 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1341 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:27.611556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:27.612222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:27.614032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-066d8154-2ffd-4fac-bbbe-e8d5bde35de4 req-b39c4c62-0826-4e5b-abe5-b4459aa54e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:27.615974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:27.615974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:27.619180 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.619627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.620434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.620864 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.623921 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-066d8154-2ffd-4fac-bbbe-e8d5bde35de4 req-b39c4c62-0826-4e5b-abe5-b4459aa54e1d service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.625712 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-066d8154-2ffd-4fac-bbbe-e8d5bde35de4 req-b39c4c62-0826-4e5b-abe5-b4459aa54e1d service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.635763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-066d8154-2ffd-4fac-bbbe-e8d5bde35de4 req-b39c4c62-0826-4e5b-abe5-b4459aa54e1d service nova] Creating event network-changed:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:34:27.641483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-066d8154-2ffd-4fac-bbbe-e8d5bde35de4 req-b39c4c62-0826-4e5b-abe5-b4459aa54e1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031428 Sep 02 04:34:27.642498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 433/872] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:34:27.708226 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lazy-loading 'services' on Instance uuid 3a7dc176-84e3-493b-8779-8d44601afe6d {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:27.796694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:27.797683 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:27.803826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.804399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.805910 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.806414 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.876733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:27.884844 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:27.886479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:27.887650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d3572bc8-4254-477b-978c-91e7cccc2e67 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1339 microversion: 2.20 time: 0.095178 Sep 02 04:34:27.888244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 434/873] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:27 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:34:27.905786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-42c4f75d-98ea-4bb4-970f-ca0736b1b6d7 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments/6a445678-c6b2-46f1-83c7-ca4d95a632ef" status: 202 len: 0 microversion: 2.1 time: 0.298453 Sep 02 04:34:27.906368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 440/874] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:34:27 2021] DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments/6a445678-c6b2-46f1-83c7-ca4d95a632ef => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:34:27.921178 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:27.922293 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:27.928338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.930492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.931375 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:27.931807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:27.961761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-22bf6897-2dbd-4bb5-aa40-373860dd2906 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 Sep 02 04:34:27.962271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 435/875] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:34:27 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:28.905717 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:28.906408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:28.912232 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:28.912676 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:28.913427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:28.914490 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:28.972919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:28.974011 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:28.975041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:28.982054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:28.982257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:28.982708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:28.983543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:28.983876 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:28.984413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:28.984657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1b54c255-9ef6-4695-943e-900bceb7aa85 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1339 microversion: 2.20 time: 0.083021 Sep 02 04:34:28.985209 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 441/876] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:28 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:34:29.016688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2ef0af8d-5107-4534-89e3-fbc36fb2f099 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047089 Sep 02 04:34:29.017384 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 436/877] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:34:28 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:34:30.003489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:30.004147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:30.010367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:30.010804 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:30.011556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:30.012035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:30.028899 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:30.030700 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:30.037453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:30.038176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:30.039199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:30.039867 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:30.071208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f11176f5-c1eb-4267-8001-8242b86053ae tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 02 04:34:30.071942 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 437/878] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:34:30 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:34:30.074268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:30.082175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:30.083684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:30.084813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-367bcf75-ad8c-4dae-bcfc-6aff2e049f9e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1339 microversion: 2.20 time: 0.086166 Sep 02 04:34:30.085369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 442/879] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:29 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:31.083883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:31.085140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:31.091566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.092021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.093035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.093470 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.109850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:31.111217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:31.117983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.118745 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.120220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.120881 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.147266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2e1dade2-2e04-4f6e-958e-34f637411e06 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067649 Sep 02 04:34:31.148341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 438/880] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:34:31 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:34:31.161891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:31.172109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:31.172109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.172109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.172109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.172543 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:31.287760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:31.297576 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] HTTP exception thrown: Instance 3a7dc176-84e3-493b-8779-8d44601afe6d is not attached to volume 6a445678-c6b2-46f1-83c7-ca4d95a632ef Sep 02 04:34:31.298036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:31.298335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Returning 404 to user: Instance 3a7dc176-84e3-493b-8779-8d44601afe6d is not attached to volume 6a445678-c6b2-46f1-83c7-ca4d95a632ef {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:34:31.299254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f52f857a-f938-473c-b255-07cbd516605a tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments/6a445678-c6b2-46f1-83c7-ca4d95a632ef" status: 404 len: 154 microversion: 2.1 time: 0.145513 Sep 02 04:34:31.299546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:31.299980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 439/881] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:34:31 2021] DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d/os-volume_attachments/6a445678-c6b2-46f1-83c7-ca4d95a632ef => generated 154 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:34:31.302732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-810ace87-2cc6-483a-b2ae-78f446b277c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.196818 Sep 02 04:34:31.305587 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 443/882] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:31 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:31.972979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-67815214-f0bb-4d14-9b1d-e437d3319d74 req-bc816cfd-787a-4ae2-a716-876a706ac1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:31.974774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:31.974774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:31.983113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-67815214-f0bb-4d14-9b1d-e437d3319d74 req-bc816cfd-787a-4ae2-a716-876a706ac1a0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:31.983702 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-67815214-f0bb-4d14-9b1d-e437d3319d74 req-bc816cfd-787a-4ae2-a716-876a706ac1a0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.001209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-67815214-f0bb-4d14-9b1d-e437d3319d74 req-bc816cfd-787a-4ae2-a716-876a706ac1a0 service nova] Creating event network-changed:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:34:32.009931 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-67815214-f0bb-4d14-9b1d-e437d3319d74 req-bc816cfd-787a-4ae2-a716-876a706ac1a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040523 Sep 02 04:34:32.011228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 440/883] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:32.323016 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:32.323860 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:32.329577 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.330032 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.330795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.331227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.523252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:32.531573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:32.535089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:32.535089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3f4e0708-11d5-4956-9683-0aa6fb57e02c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.215721 Sep 02 04:34:32.535089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 444/884] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:32 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:32.594726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:32.595390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:32.605685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.606133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.606902 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.607329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.632257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:34:32.974100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-205ada3e-5fe3-4dcc-b5a2-6f88b400ccea tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 204 len: 0 microversion: 2.1 time: 0.382786 Sep 02 04:34:32.974689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 441/885] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:34:32 2021] DELETE /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 04:34:32.984236 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:32.984850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:32.990584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.991031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:32.991781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:32.992256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:33.112123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:33.120146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-76352e83-9788-4ccc-bd2d-ba41d066dd56 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1551 microversion: 2.1 time: 0.140644 Sep 02 04:34:33.120718 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 445/886] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:32 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1551 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:33.552326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:33.553107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:33.559614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:33.560100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:33.560868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:33.561300 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:33.687144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:33.695266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:33.697157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:33.698388 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-46735b02-833f-427b-8a1c-b519d7a34441 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.150227 Sep 02 04:34:33.698928 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 442/887] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:33 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:33.940645 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:33.941137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:33.946813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:33.947253 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:33.948031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:33.948456 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:34.031773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lazy-loading 'services' on Instance uuid 95674748-4b1b-4dbb-98d6-fb5403a9d5ca {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:34.137677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:34.138279 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:34.144106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:34.144545 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:34.145289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:34.145713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:34.262633 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-91c2362d-0a06-41b0-83ac-bf2d1ec3aa1d tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca/os-volume_attachments/4b0eb18f-3d80-4340-a57e-4aed2c495737" status: 202 len: 0 microversion: 2.1 time: 0.326904 Sep 02 04:34:34.263235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 446/888] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:34:33 2021] DELETE /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca/os-volume_attachments/4b0eb18f-3d80-4340-a57e-4aed2c495737 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:34:34.267714 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:34.277693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-99032556-f086-4725-839a-5b3d02baf67d tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1551 microversion: 2.1 time: 0.142876 Sep 02 04:34:34.277693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 443/889] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:34 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1551 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:34.716128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:34.716744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:34.722792 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:34.723234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:34.724269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:34.724702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:34.844627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-885559651", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "116d17e0-f7af-4097-899a-e7111647f627"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:34.848003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:34.856858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:34.861146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:34.861146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-28beba4b-a021-4159-8677-54a038661e7b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.147655 Sep 02 04:34:34.861146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 447/890] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:34 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:34.895723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] validate_networks() for [('116d17e0-f7af-4097-899a-e7111647f627', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:34:35.239205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:34:35.239642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:34:35.240139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:34:35.240544 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:34:35.240975 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:34:35.250005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.250436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:35.251434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.251854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:35.272459 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Getting quotas for project 3db6fa006b6f47ee95cae83d696c4b8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:35.276723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Getting quotas for user 698c12a4ccef49d690bf2412c5ee6868 and project 3db6fa006b6f47ee95cae83d696c4b8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:35.289192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:34:35.292418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:34:35.298228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:35.298228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:35.303621 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.304107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:35.304923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.306629 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:35.432248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:35.438778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f759a412-e43e-4e81-b018-67d2ff4b435c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597697 Sep 02 04:34:35.439745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 444/891] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:34:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 04:34:35.444570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-935a27fc-0297-4e62-b06f-1e83da4f67a2 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1551 microversion: 2.1 time: 0.147921 Sep 02 04:34:35.444570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 448/892] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:35 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:35.449926 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e87c7b2-a870-4c08-83f0-eb7018606f44 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:35.450537 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e87c7b2-a870-4c08-83f0-eb7018606f44 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:35.510813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8e87c7b2-a870-4c08-83f0-eb7018606f44 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:35.517244 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e87c7b2-a870-4c08-83f0-eb7018606f44 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1213 microversion: 2.1 time: 0.071633 Sep 02 04:34:35.517807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 449/893] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:35 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:35.877732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:35.878342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:35.884907 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.885427 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:35.886196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:35.886636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.081629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:36.089284 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:36.090805 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:36.091894 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cf640f9c-3e1e-4504-aa7c-64fd081686d8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.217988 Sep 02 04:34:36.092481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 445/894] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:35 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:36.285034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-a3232cf1-fb2e-45c6-a862-27c678a31cdd req-5b591953-b339-4c71-bf86-dc0088f7d097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7dc176-84e3-493b-8779-8d44601afe6d", "name": "network-vif-deleted", "tag": "c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:36.286724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:36.286724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:36.294140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a3232cf1-fb2e-45c6-a862-27c678a31cdd req-5b591953-b339-4c71-bf86-dc0088f7d097 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.295878 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a3232cf1-fb2e-45c6-a862-27c678a31cdd req-5b591953-b339-4c71-bf86-dc0088f7d097 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.306557 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-a3232cf1-fb2e-45c6-a862-27c678a31cdd req-5b591953-b339-4c71-bf86-dc0088f7d097 service nova] Creating event network-vif-deleted:c004b6d9-51a8-4a21-b8ad-67bf2b4b8a28 for instance 3a7dc176-84e3-493b-8779-8d44601afe6d on hv-cinder-80473 Sep 02 04:34:36.311353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-a3232cf1-fb2e-45c6-a862-27c678a31cdd req-5b591953-b339-4c71-bf86-dc0088f7d097 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 Sep 02 04:34:36.311965 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 450/895] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:36.440271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:36.440761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:36.446539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.446989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.450072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.450072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.457427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:36.458272 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:36.464647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.465349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.466351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.466990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.472467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:34:36.542957 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:36.550275 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ad02ea72-7e0c-4927-b030-a950ef36e8b8 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1342 microversion: 2.1 time: 0.096871 Sep 02 04:34:36.550853 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 451/896] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:36 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1342 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:36.555335 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:36.556680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:36.562990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.563458 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.564264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:36.564722 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:36.629635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:36.637359 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-03e162f7-cc30-4c31-b273-eec16860b844 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1217 microversion: 2.1 time: 0.085431 Sep 02 04:34:36.637999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 452/897] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:36 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:37.110141 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:37.110753 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:37.116530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.116910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.117670 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.118102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.147122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f1c985c0-0834-47f9-8d27-c1498ed1e9a3 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 204 len: 0 microversion: 2.1 time: 0.708689 Sep 02 04:34:37.150616 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 446/898] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:34:36 2021] DELETE /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:34:37.159499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:37.161283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:37.168123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.168951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.170112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.170882 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.245837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.255199 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.257581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.259339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f4aba287-d9ce-423a-b0e6-2ea92af1dc2f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.153007 Sep 02 04:34:37.260012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 453/899] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:37 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:37.308910 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.316313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-71359f74-efb3-48e5-b40e-b7261ead56db tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1513 microversion: 2.1 time: 0.161310 Sep 02 04:34:37.316873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 447/900] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:37 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:37.568162 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:37.568773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:37.575291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.575738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.576529 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.576961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.606686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.607131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.607571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lazy-loading 'fault' on Instance uuid 3a7dc176-84e3-493b-8779-8d44601afe6d {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:37.649372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abeea085a0024fc98d88cf91ce800749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dd2e352f6149d4beb1d4f84664a614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.656121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:37.656900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cdd448ce-e4b8-4d81-8aff-bf26fe87c891 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 200 len: 1347 microversion: 2.1 time: 0.092642 Sep 02 04:34:37.657047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:37.657919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 454/901] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:37 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 1347 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:37.663570 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.664061 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.664859 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:37.665473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:37.726517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:37.734127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cdb5c606-1a78-444d-bf2b-563b7c2265d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1265 microversion: 2.1 time: 0.083458 Sep 02 04:34:37.734697 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 448/902] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:37 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:38.278097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:38.278710 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:38.289360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.290477 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.299825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.300306 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.338746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:38.341316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:38.349546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.349986 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.350745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.351169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.422904 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:38.431447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:38.433022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:38.434140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9bc124f4-c6a6-42b1-83c7-27eb4591b192 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.160383 Sep 02 04:34:38.434972 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 455/903] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:38 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:38.524354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:38.541319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bc2dd581-1e23-42a4-a3aa-361c55c0c978 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1513 microversion: 2.1 time: 0.201572 Sep 02 04:34:38.541319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 449/904] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:38 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:38.673409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:38.674014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] [instance: 3a7dc176-84e3-493b-8779-8d44601afe6d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:38.679678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.680159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.681480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.681910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.694867 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] HTTP exception thrown: Instance 3a7dc176-84e3-493b-8779-8d44601afe6d could not be found. Sep 02 04:34:38.695447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Returning 404 to user: Instance 3a7dc176-84e3-493b-8779-8d44601afe6d could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:34:38.696319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b6aab556-c2d0-465f-a524-1f2ef8995365 tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d" status: 404 len: 111 microversion: 2.1 time: 0.026639 Sep 02 04:34:38.696849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 456/905] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:38 2021] GET /compute/v2.1/servers/3a7dc176-84e3-493b-8779-8d44601afe6d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:34:38.704939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ce562da8-7933-486d-8667-cf3ac064318b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] Calling method '.version_select at 0x7fa04b3e1940>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:38.751474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:38.752269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:38.758031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.758481 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.759239 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:38.759672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:38.808453 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ce562da8-7933-486d-8667-cf3ac064318b tempest-TestMinimumBasicScenario-2135139301 tempest-TestMinimumBasicScenario-2135139301-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779197721" status: 202 len: 0 microversion: 2.1 time: 0.106952 Sep 02 04:34:38.810628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 450/906] 10.222.0.13 () {58 vars in 1269 bytes} [Thu Sep 2 04:34:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-779197721 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:34:38.846459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:38.858248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-79f5e2a3-9fe1-4410-92e5-e4ddce3bc0c1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1271 microversion: 2.1 time: 0.110410 Sep 02 04:34:38.861475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 457/907] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:38 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:39.059675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-81e84e52-588d-46ba-86bf-475a796e1640 req-63a963b9-c05b-4164-95c2-dcca2a1d9c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "name": "network-vif-plugged", "status": "completed", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:39.061315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:39.061315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:39.068707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-81e84e52-588d-46ba-86bf-475a796e1640 req-63a963b9-c05b-4164-95c2-dcca2a1d9c86 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.069222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-81e84e52-588d-46ba-86bf-475a796e1640 req-63a963b9-c05b-4164-95c2-dcca2a1d9c86 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.080605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-81e84e52-588d-46ba-86bf-475a796e1640 req-63a963b9-c05b-4164-95c2-dcca2a1d9c86 service nova] Creating event network-vif-plugged:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:34:39.087983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-81e84e52-588d-46ba-86bf-475a796e1640 req-63a963b9-c05b-4164-95c2-dcca2a1d9c86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031882 Sep 02 04:34:39.088826 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 451/908] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:39.452227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:39.452833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:39.459111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.463033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.463033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.463033 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.549472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:39.550241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:39.556535 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.556973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.558049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.558478 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.592198 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:39.601822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:39.603594 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:39.604841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c620c34b-2f2f-4df0-84e0-50cd3a81d256 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.156326 Sep 02 04:34:39.606448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 458/909] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:39 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:39.874540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:39.875162 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:39.881513 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.881960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:39.882750 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:39.883180 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:40.130276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:40.139351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-513c05a2-76e3-4c16-acd4-e485f0f751d7 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.268397 Sep 02 04:34:40.143438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 459/910] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:39 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:40.256378 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:40.261175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bcbc033f-92d3-408c-8c3e-521760484fd0 tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1513 microversion: 2.1 time: 0.715620 Sep 02 04:34:40.261745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 452/911] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:39 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1513 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:40.622464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:40.623065 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:40.628784 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:40.633636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:40.633636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:40.633636 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:40.779204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:40.787463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:40.797366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:40.797366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c85733c5-77f8-491b-8562-a9dd63f94319 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1406 microversion: 2.20 time: 0.172769 Sep 02 04:34:40.797366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 460/912] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:40 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:40.826983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-b35a4549-5cb1-4071-9f47-8ea8de380e6d req-4cdefbf2-ccfc-4024-969f-1440204c7136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9dbb48-2b3d-4dae-80f5-7f5cf9665eec", "tag": "c127bbc0-a3fc-4af8-84a7-df5c68f828ac"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:40.829104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:40.829104 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:40.837866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b35a4549-5cb1-4071-9f47-8ea8de380e6d req-4cdefbf2-ccfc-4024-969f-1440204c7136 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:40.838314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b35a4549-5cb1-4071-9f47-8ea8de380e6d req-4cdefbf2-ccfc-4024-969f-1440204c7136 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:40.850007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-b35a4549-5cb1-4071-9f47-8ea8de380e6d req-4cdefbf2-ccfc-4024-969f-1440204c7136 service nova] Creating event network-changed:c127bbc0-a3fc-4af8-84a7-df5c68f828ac for instance af9dbb48-2b3d-4dae-80f5-7f5cf9665eec on hv-cinder-80473 Sep 02 04:34:40.854918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-b35a4549-5cb1-4071-9f47-8ea8de380e6d req-4cdefbf2-ccfc-4024-969f-1440204c7136 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Sep 02 04:34:40.855518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 453/913] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:41.155702 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.158433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.166163 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.166163 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.166738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.167268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.279186 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.280235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.292207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.294769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.295595 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.296099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.347530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:41.350028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.350849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.351735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lazy-loading 'fault' on Instance uuid 95674748-4b1b-4dbb-98d6-fb5403a9d5ca {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:41.367122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-68404a0a-bf34-4627-9870-78ab496408d3 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.214979 Sep 02 04:34:41.368865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 461/914] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:41 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:41.404200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa8d7424a374b0faa2b31eda4ef711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575695d7181e435fb176d616cafa196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:41.412836 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-db45ff74-0df5-42dd-8084-aca1728ddfda tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 200 len: 1309 microversion: 2.1 time: 0.137751 Sep 02 04:34:41.413581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 454/915] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:41 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:41.577299 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.578279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.584770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.585230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.586052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.586565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.615761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-21f7bb47-7c10-436f-8eef-a1714f161725 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042208 Sep 02 04:34:41.616383 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 462/916] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:34:41 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:34:41.677176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.677672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.683569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.684053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.684819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.685283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.710541 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:34:41.809531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.810087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.816410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.817228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.818020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.818475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.939711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:41.948457 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:41.951839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:41.951839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-357eeef3-beaf-4030-9ab6-9b41dfab90a3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1599 microversion: 2.20 time: 0.145782 Sep 02 04:34:41.952760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 463/917] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:34:41 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:34:41.970803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:41.972040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:41.979106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.979791 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:41.981137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:41.981497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.028179 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ec1688fc-f544-47ab-b128-968493f65840 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 204 len: 0 microversion: 2.1 time: 0.354566 Sep 02 04:34:42.029671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 455/918] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:34:41 2021] DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:34:42.039833 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:42.040633 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:42.052121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.052121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.052314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.052719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.088550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4c219152-1f92-4696-898f-938406a510bb tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122051 Sep 02 04:34:42.095203 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 464/919] 10.222.0.13 () {60 vars in 1316 bytes} [Thu Sep 2 04:34:41 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:34:42.294521 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:42.303088 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3f7cfc9b-4bd3-47a3-a51b-0ea0ae6f1d48 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1671 microversion: 2.1 time: 0.268949 Sep 02 04:34:42.304196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 456/920] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:42 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:42.385857 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:42.386460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:42.392505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.392948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.393700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.394400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.433512 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:42.434124 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] [instance: 95674748-4b1b-4dbb-98d6-fb5403a9d5ca] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:42.440214 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.440748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.441573 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.442062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.456349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] HTTP exception thrown: Instance 95674748-4b1b-4dbb-98d6-fb5403a9d5ca could not be found. Sep 02 04:34:42.456933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] Returning 404 to user: Instance 95674748-4b1b-4dbb-98d6-fb5403a9d5ca could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:34:42.457760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5876057c-6a4d-4e05-8d46-48f45252b98e tempest-VolumesSnapshotTestJSON-47757295 tempest-VolumesSnapshotTestJSON-47757295-project] 10.222.0.13 "GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca" status: 404 len: 111 microversion: 2.1 time: 0.027961 Sep 02 04:34:42.458324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 457/921] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:42 2021] GET /compute/v2.1/servers/95674748-4b1b-4dbb-98d6-fb5403a9d5ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:34:42.651286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:42.662409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-06c20925-66c9-4ddf-ac2a-4d7aca7c1644 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.278710 Sep 02 04:34:42.662409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 465/922] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:42 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:42.877434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-00ce6fca-dc67-41b1-87b6-3cdb869a01ac req-5f7c4783-6c21-44a7-a7d7-f5e194431655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95674748-4b1b-4dbb-98d6-fb5403a9d5ca", "name": "network-vif-deleted", "tag": "26a563ab-3b33-425b-adb7-b73da80f7062"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:42.879177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:42.879177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:42.890150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-00ce6fca-dc67-41b1-87b6-3cdb869a01ac req-5f7c4783-6c21-44a7-a7d7-f5e194431655 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:42.893137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-00ce6fca-dc67-41b1-87b6-3cdb869a01ac req-5f7c4783-6c21-44a7-a7d7-f5e194431655 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:42.911489 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-00ce6fca-dc67-41b1-87b6-3cdb869a01ac req-5f7c4783-6c21-44a7-a7d7-f5e194431655 service nova] Creating event network-vif-deleted:26a563ab-3b33-425b-adb7-b73da80f7062 for instance 95674748-4b1b-4dbb-98d6-fb5403a9d5ca on hv-cinder-80473 Sep 02 04:34:42.920262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-00ce6fca-dc67-41b1-87b6-3cdb869a01ac req-5f7c4783-6c21-44a7-a7d7-f5e194431655 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045852 Sep 02 04:34:42.921806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 458/923] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:43.320635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:43.321999 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:43.329797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.330680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.331803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.332373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.565340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:43.576265 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a9e3ded-4eed-4b8e-a1c8-e4243efba4c1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1671 microversion: 2.1 time: 0.259237 Sep 02 04:34:43.577786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 466/924] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:43 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:43.635315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:43.636350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:43.638572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-885fef80-1047-44eb-9a39-61899051b84b req-175ff7c9-bdf9-43ce-9399-bd1c601a5c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:43.640522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:43.640522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:43.646501 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.646945 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.647733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.648198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.652744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-885fef80-1047-44eb-9a39-61899051b84b req-175ff7c9-bdf9-43ce-9399-bd1c601a5c92 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.653387 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-885fef80-1047-44eb-9a39-61899051b84b req-175ff7c9-bdf9-43ce-9399-bd1c601a5c92 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.669575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-885fef80-1047-44eb-9a39-61899051b84b req-175ff7c9-bdf9-43ce-9399-bd1c601a5c92 service nova] Creating event network-changed:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:34:43.682063 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-885fef80-1047-44eb-9a39-61899051b84b req-175ff7c9-bdf9-43ce-9399-bd1c601a5c92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047134 Sep 02 04:34:43.683114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 467/925] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:43.691895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:43.692870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:43.703322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.704026 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.705205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:43.705638 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:43.767978 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1815832a-5992-4152-ab5e-539b81cc2d4e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 0.137160 Sep 02 04:34:43.769354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 459/926] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:43 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:43.847882 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:43.856573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c5a912f5-9fbf-419e-8cbb-523997555d93 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.172007 Sep 02 04:34:43.857177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 468/927] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:43 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:44.595369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:44.596184 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:44.603495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.603974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:44.604830 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.605211 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:44.780437 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:44.781682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:44.808892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.812560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:44.813768 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.814360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:44.937955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:44.946306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-67a230dc-ff9c-421d-bfdc-324314e41974 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1671 microversion: 2.1 time: 0.354547 Sep 02 04:34:44.948044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-18136d80-2d99-4a47-951a-d17b080245b0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 0.172240 Sep 02 04:34:44.949293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 469/928] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:44 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:44.954811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:44.955712 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:44.959590 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 460/929] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:44 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1671 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:44.962961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.963622 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:44.964573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:44.965153 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:45.197338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:45.206950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-efcf61e4-e2c0-47fa-9856-009babf22f2b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.256323 Sep 02 04:34:45.223831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 470/930] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:44 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:45.938237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-6a622141-5a11-47c5-a49e-f2444a09f9b3 req-3dfc4d16-95af-4a23-a889-5cfb97afc7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdfd22-1160-4f16-ad90-ec2fd5150229", "name": "network-vif-deleted", "tag": "eae12a40-174f-4aa8-b249-61f0b2903ae6"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:45.940440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:45.940440 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:34:45.948158 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6a622141-5a11-47c5-a49e-f2444a09f9b3 req-3dfc4d16-95af-4a23-a889-5cfb97afc7ea service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:45.950012 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6a622141-5a11-47c5-a49e-f2444a09f9b3 req-3dfc4d16-95af-4a23-a889-5cfb97afc7ea service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:45.961026 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:45.962996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:45.966186 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-6a622141-5a11-47c5-a49e-f2444a09f9b3 req-3dfc4d16-95af-4a23-a889-5cfb97afc7ea service nova] Creating event network-vif-deleted:eae12a40-174f-4aa8-b249-61f0b2903ae6 for instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 on hv-cinder-80473 Sep 02 04:34:45.969815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:45.970460 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:45.971301 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:45.971750 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:45.972705 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-6a622141-5a11-47c5-a49e-f2444a09f9b3 req-3dfc4d16-95af-4a23-a889-5cfb97afc7ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038254 Sep 02 04:34:45.974089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 461/931] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:34:45.985109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:45.990274 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:46.000383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:46.002340 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:46.003407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:46.004099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:46.074509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:46.082691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3a97f9ad-577a-4852-9c84-2f7f2284f0f6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1604 microversion: 2.1 time: 0.101467 Sep 02 04:34:46.087658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 462/932] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:45 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:46.224291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:46.225207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:46.231224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:46.231671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:46.232475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:46.232932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:46.362350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:46.370951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f673aedf-d75e-43be-bc2f-9673ef6be34e tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.150563 Sep 02 04:34:46.372751 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 463/933] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:46 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:47.101254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:47.101965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:47.109322 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:47.109719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:47.110495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:47.110928 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:47.173993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:47.181965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d23c7156-d0a5-427c-8798-e95b5173be1b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1604 microversion: 2.1 time: 0.085146 Sep 02 04:34:47.182541 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 464/934] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:47 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:47.392475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:47.393292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:47.399638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:47.400194 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:47.401043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:47.401368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:47.524366 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:47.531774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a4ab8207-15d4-42e6-8862-f1da763a5eaa tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.142858 Sep 02 04:34:47.532376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 465/935] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:47 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:47.710271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:34:47.710967 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:34:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action (ip 10.222.0.13) !!! Sep 02 04:34:47.792788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-730091ec-2114-420d-a84f-be7b34d5d0f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 1.836973 Sep 02 04:34:47.793619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 471/936] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:45 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:48.199240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:48.199840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:48.206286 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.206803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.207586 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.208064 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.239918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.240381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.240821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lazy-loading 'fault' on Instance uuid a1fdfd22-1160-4f16-ad90-ec2fd5150229 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:34:48.280226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:48.287727 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-345b93e7-a8b8-4229-b91f-1f095423be3e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 200 len: 1327 microversion: 2.1 time: 0.092852 Sep 02 04:34:48.288647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 466/937] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:48 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:48.548221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:48.548922 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:48.555884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.556347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.557102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.557532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.685700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:48.692221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d20c4a67-d9ba-4a7e-b7a9-e42849fcd572 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.147985 Sep 02 04:34:48.692995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 472/938] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:48 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:48.803737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:48.804693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:48.814280 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.814720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.815665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:48.816123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:48.919415 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-daf21606-169b-49df-adc8-2530a4e28cad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 0.119461 Sep 02 04:34:48.920385 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 467/939] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:48 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:49.305523 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:49.308107 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:49.312588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.313092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:49.313871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.314521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:49.330677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. Sep 02 04:34:49.331513 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:34:49.332510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2b380141-25bd-46ca-94e3-a95d3f42c39f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 404 len: 111 microversion: 2.1 time: 0.030835 Sep 02 04:34:49.337176 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 473/940] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:49 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:34:49.344441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-80e50d8e-e5c6-4197-bdfb-becb3b5042f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '.version_select at 0x7fa04b2aa670>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:49.449811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-80e50d8e-e5c6-4197-bdfb-becb3b5042f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105346202" status: 202 len: 0 microversion: 2.1 time: 0.109311 Sep 02 04:34:49.450405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 468/941] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Sep 2 04:34:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105346202 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:34:49.712578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:49.714566 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:49.723586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.724412 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:49.725901 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.726558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:49.874914 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:49.877565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-798872ae-5fc2-4581-a757-d8ab9849789b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.171862 Sep 02 04:34:49.887805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 474/942] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:49 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:49.931328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:49.932505 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:49.944640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.945801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:49.947224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:49.948067 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:50.042231 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3a02352f-73b8-4668-99dd-a67ab01ea12c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 0.115360 Sep 02 04:34:50.043647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 469/943] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:49 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:50.110700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-edba1029-21cd-4822-ac21-2b63301e2c09 req-ef74c056-ade7-48e9-8332-225fc4386453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9dbb48-2b3d-4dae-80f5-7f5cf9665eec", "name": "network-vif-plugged", "status": "completed", "tag": "c127bbc0-a3fc-4af8-84a7-df5c68f828ac"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:50.112344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:50.112344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:50.119248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-edba1029-21cd-4822-ac21-2b63301e2c09 req-ef74c056-ade7-48e9-8332-225fc4386453 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:50.119737 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-edba1029-21cd-4822-ac21-2b63301e2c09 req-ef74c056-ade7-48e9-8332-225fc4386453 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:50.130700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-edba1029-21cd-4822-ac21-2b63301e2c09 req-ef74c056-ade7-48e9-8332-225fc4386453 service nova] Creating event network-vif-plugged:c127bbc0-a3fc-4af8-84a7-df5c68f828ac for instance af9dbb48-2b3d-4dae-80f5-7f5cf9665eec on hv-cinder-80473 Sep 02 04:34:50.135524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-edba1029-21cd-4822-ac21-2b63301e2c09 req-ef74c056-ade7-48e9-8332-225fc4386453 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 Sep 02 04:34:50.136131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 475/944] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:34:50.330175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: .version_select at 0x7fa04b1c59d0>, body: {"keypair": {"name": "tempest-keypair-1822432974"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:50.346117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:50.350141 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:50.781266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:50.784888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:50.798110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-81c5a950-6207-4162-896d-82f67e9601c3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.473800 Sep 02 04:34:50.798688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 470/945] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Sep 2 04:34:50 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:50.894842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:50.895451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:50.902222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:50.902674 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:50.903442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:50.903881 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:51.045208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:51.053104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2bdcfac8-f0cd-41da-93ee-3f4a4b6173f9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.162315 Sep 02 04:34:51.053672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 476/946] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:50 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:51.215150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:51.216238 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:51.222444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:51.222888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:51.223932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:51.224360 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:52.069721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:52.070360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:52.076731 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:52.077171 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:52.077928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:52.092037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:52.203588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:52.214116 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-edab349a-b4b5-4137-bfc8-ece7ed7afbb8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.148029 Sep 02 04:34:52.214895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 477/947] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:52 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:53.231151 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:53.231754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:53.237578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:53.238018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:53.238766 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:53.239348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:53.425375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:53.433428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-976c9965-3456-4a63-be1e-a14451b99e7f tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.206631 Sep 02 04:34:53.433899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 478/948] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:53 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:53.518743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1844972673", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad90c133-531e-4d6b-a1ec-5f41d66215bb"}], "security_groups": [{"name": "tempest-securitygroup--105774823"}], "key_name": "tempest-keypair-1822432974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:53.616282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] validate_networks() for [('ad90c133-531e-4d6b-a1ec-5f41d66215bb', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:34:53.784567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-14933841-2530-4610-8213-e667f56acc73 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 2.734052 Sep 02 04:34:53.791744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 471/949] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:51 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:54.047544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:34:54.048089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:34:54.048627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:34:54.049035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:34:54.049470 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:34:54.058818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.059257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.060106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.060530 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.078416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:34:54.082581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Getting quotas for user 9b791f5771da4415b056655a1b3aed49 and project b7c30d815e4b455b8ab704d7e86dbf2f. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:34:54.093521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:34:54.095847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:34:54.251496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-663efff2-e9e3-4542-98ef-1917775eb486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.736874 Sep 02 04:34:54.253252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 479/950] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:34:53 2021] POST /compute/v2.1/servers => generated 401 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:34:54.263661 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ad6cce7f-35cb-47cb-a7a3-5c5fce23409f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:54.264672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ad6cce7f-35cb-47cb-a7a3-5c5fce23409f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:54.337013 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ad6cce7f-35cb-47cb-a7a3-5c5fce23409f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:54.344114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ad6cce7f-35cb-47cb-a7a3-5c5fce23409f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1238 microversion: 2.1 time: 0.084392 Sep 02 04:34:54.345221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 472/951] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:54 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:54.448776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:54.449355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:54.455315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.455760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.456560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.456992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.614498 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:54.624479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7ab1055c-e46e-46d7-b971-a2afffdc8ea4 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1313 microversion: 2.1 time: 0.179255 Sep 02 04:34:54.625651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 480/952] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:54 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:54.797908 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:54.798760 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:54.806741 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.807114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.807893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:54.808339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:54.927491 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d65d89ef-397d-4527-b86e-2225f053d093 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 14 microversion: 2.20 time: 0.133577 Sep 02 04:34:54.928882 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 473/953] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:54 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:55.362635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:55.363315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:55.370144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.370783 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:55.380698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.380698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:55.449934 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:55.458747 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-76daffda-4842-4b9a-8a62-ea5435f27a7f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1242 microversion: 2.1 time: 0.100077 Sep 02 04:34:55.460377 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 481/954] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:55 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:55.642121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:55.643076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:55.654686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.655142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:55.656060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.662579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:55.830900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:55.840175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5fd09b06-6132-4043-aff2-30f659519a65 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1497 microversion: 2.1 time: 0.201963 Sep 02 04:34:55.840530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 474/955] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:55 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:55.940764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:55.942200 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:55.948071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.948519 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:55.949283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:55.949716 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:56.037081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e72c2aff-3138-4979-b86c-1cd8f7321e14 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 6451 microversion: 2.20 time: 0.101775 Sep 02 04:34:56.037928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 482/956] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:55 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 6451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:34:56.656387 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:56.657218 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:56.668358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:56.671207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:56.672082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:56.674039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:56.766840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:56.775582 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b28b3818-b939-4b3f-bd8e-1bf506e006b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1290 microversion: 2.1 time: 0.302866 Sep 02 04:34:56.776304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 475/957] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:56 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1290 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:57.049923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:57.051939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:57.059545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.060065 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.060840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.061491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.150785 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ec053b06-88ec-426d-b2f0-b8e514b04f57 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 15025 microversion: 2.20 time: 0.104985 Sep 02 04:34:57.151895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 483/958] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:57 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 15025 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:34:57.212301 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:57.212891 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:57.226266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.227581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.228597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.229102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.269863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:34:57.794818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:57.795746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:57.810344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.811068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.812271 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.812975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.862897 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-60e24e56-7595-468d-8721-c18b61f8ddfd tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "DELETE /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 204 len: 0 microversion: 2.1 time: 0.654099 Sep 02 04:34:57.863954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 476/959] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:34:57 2021] DELETE /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:34:57.873171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:57.874194 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:57.889463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.894039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.895188 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:57.896682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:57.949345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:57.959947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1314e4eb-8c8f-481b-be70-c76a99a12f43 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1296 microversion: 2.1 time: 0.168951 Sep 02 04:34:57.962325 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 484/960] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:57 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:58.157315 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:58.164310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:58.166322 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:58.168499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1d57268c-94e0-4ad4-b828-1bd141751c06 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.299160 Sep 02 04:34:58.169512 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 477/961] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:57 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:58.178213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:58.179087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:58.179433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:58.179865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:58.289275 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7b01b9d7-ecae-41ec-b9d0-cb5cecd1a9d9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 18155 microversion: 2.20 time: 0.130462 Sep 02 04:34:58.290555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 485/962] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:58 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 18155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:34:58.979744 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:58.980425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:58.988614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:58.989023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:58.989808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:58.990244 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.191022 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:34:59.192928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:59.200431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:59.201307 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.202793 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:59.203602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.207807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:59.225082 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-20db83c8-2340-4405-bf80-862a51ee67e4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.248652 Sep 02 04:34:59.234669 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 478/963] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:58 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:34:59.301049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:59.306169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:34:59.310763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:59.311390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.312510 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:59.313187 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.498807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:34:59.532492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-121d2f6e-f3a5-4d7a-bea9-cbea21c2d7d9 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.345845 Sep 02 04:34:59.543655 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 486/964] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:34:59 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:34:59.788694 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-9917d982-f92b-442b-8aed-da64b7d7d95f req-70d60873-4585-4f68-815e-d107cf892336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c4704c6-71ce-41e9-a0e4-6945d86eac98", "tag": "30234d74-b9ed-48a4-ac77-9d01af5c2a78"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:34:59.790845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:34:59.790845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:34:59.819222 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-9917d982-f92b-442b-8aed-da64b7d7d95f req-70d60873-4585-4f68-815e-d107cf892336 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:34:59.819660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-9917d982-f92b-442b-8aed-da64b7d7d95f req-70d60873-4585-4f68-815e-d107cf892336 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:34:59.855204 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-9917d982-f92b-442b-8aed-da64b7d7d95f req-70d60873-4585-4f68-815e-d107cf892336 service nova] Creating event network-changed:30234d74-b9ed-48a4-ac77-9d01af5c2a78 for instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 on hv-cinder-80473 Sep 02 04:34:59.865462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-9917d982-f92b-442b-8aed-da64b7d7d95f req-70d60873-4585-4f68-815e-d107cf892336 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080600 Sep 02 04:34:59.866168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 487/965] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:34:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:00.243019 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:00.243731 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:00.249770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:00.250210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:00.250967 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:00.251401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:00.387375 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:00.395697 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1a67e10d-0085-44b4-b5e0-01430bc410b5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.157168 Sep 02 04:35:00.396474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 488/966] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:00 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:00.550635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:00.551845 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:00.558810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:00.559283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:00.560160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:00.560598 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:00.688077 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:00.696106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-111dd6f9-27c2-4151-8f9d-5bb4b0e012e2 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.148740 Sep 02 04:35:00.696704 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 489/967] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:00 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:01.412876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:01.413499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:01.421326 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:01.421765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:01.422545 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:01.423047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:01.565007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:01.572261 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aed4922d-e40c-40fe-b58b-438121dd208f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.163192 Sep 02 04:35:01.572818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 490/968] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:01 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:01.713549 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:01.714406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:01.720544 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:01.721298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:01.722313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:01.722961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:01.882534 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0a71ecb8-9332-411f-a4dd-4697b757bc1e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 23243 microversion: 2.20 time: 2.585109 Sep 02 04:35:01.884910 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 479/969] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:34:59 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 23243 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:01.896631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:01.904835 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7875a23b-f783-4214-8967-ba7941b5909c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.195923 Sep 02 04:35:01.905408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 491/970] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:01 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:02.589974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:02.590834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:02.600869 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.602193 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:02.603228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.603934 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:02.754272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:02.762170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d1255fc8-2180-45bd-923e-ccfae80cdc03 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.176463 Sep 02 04:35:02.762833 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 480/971] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:02 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:02.895254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:02.896206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:02.903206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.903644 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:02.904444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.904868 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:02.922231 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:02.923650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:02.939232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.940024 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:02.945407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:02.946416 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:03.114851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:03.123138 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3d43451c-ecce-4388-b9fc-272719100cbe tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.204995 Sep 02 04:35:03.133397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 481/972] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:02 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:03.779365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:03.779998 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:03.787848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:03.788368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:03.789142 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:03.789569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:03.922958 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:03.932139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9718c8b8-f611-4af2-9c6b-24acb0d0c39c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.157282 Sep 02 04:35:03.933339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 482/973] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:03 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:04.140038 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:04.140942 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:04.146664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:04.147102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:04.148081 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:04.148700 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:04.290932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:04.300629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a76a07af-de99-4f10-8380-76e828ef4962 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.164122 Sep 02 04:35:04.310972 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 483/974] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:04 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:04.949615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:04.950349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:04.956409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:04.956965 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:04.957823 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:04.958353 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:05.086461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:05.094527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d9317d4e-ceef-440f-bf7f-f33718293261 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.149025 Sep 02 04:35:05.095106 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 484/975] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:04 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:05.288884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b3a58ad9-9712-4432-b50f-b4d228496785 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 27593 microversion: 2.20 time: 2.397137 Sep 02 04:35:05.290518 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 492/976] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:02 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 27593 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:05.317854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:05.318737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:05.326694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:05.327372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:05.328350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:05.328962 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:05.943273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:05.957924 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d95439a6-9f7c-44b9-b4ed-052dbd106bc8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1503 microversion: 2.1 time: 0.643750 Sep 02 04:35:05.964624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 485/977] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:05 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1503 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:06.112664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:06.113617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:06.120280 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.120979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.121936 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.122537 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.302024 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:06.307170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:06.309940 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.310584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.311865 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.312481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.350572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:06.358568 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-607a65f4-0802-4dd8-80eb-82546e846cd2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.249767 Sep 02 04:35:06.359158 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 493/978] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:06 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:06.409748 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9c5d0f0c-0803-466b-948e-30073d0bdae4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 27957 microversion: 2.20 time: 0.112526 Sep 02 04:35:06.410316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 486/979] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:06 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 27957 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:35:06.723841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-e1fb6dd4-1bc1-457d-b32e-9afc3e37e0e2 req-d94c8aa4-bfb5-4c1a-b3ed-95ca561cde70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9dbb48-2b3d-4dae-80f5-7f5cf9665eec", "name": "network-vif-deleted", "tag": "c127bbc0-a3fc-4af8-84a7-df5c68f828ac"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:06.725473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:06.725473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:35:06.750020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-e1fb6dd4-1bc1-457d-b32e-9afc3e37e0e2 req-d94c8aa4-bfb5-4c1a-b3ed-95ca561cde70 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.758652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-e1fb6dd4-1bc1-457d-b32e-9afc3e37e0e2 req-d94c8aa4-bfb5-4c1a-b3ed-95ca561cde70 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.765276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-e1fb6dd4-1bc1-457d-b32e-9afc3e37e0e2 req-d94c8aa4-bfb5-4c1a-b3ed-95ca561cde70 service nova] Creating event network-vif-deleted:c127bbc0-a3fc-4af8-84a7-df5c68f828ac for instance af9dbb48-2b3d-4dae-80f5-7f5cf9665eec on hv-cinder-80473 Sep 02 04:35:06.779398 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-e1fb6dd4-1bc1-457d-b32e-9afc3e37e0e2 req-d94c8aa4-bfb5-4c1a-b3ed-95ca561cde70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300727 Sep 02 04:35:06.783140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 494/980] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:06.984289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:06.984289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:06.984289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.984860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:06.985397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:06.986107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.026659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:07.027335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.027976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lazy-loading 'fault' on Instance uuid af9dbb48-2b3d-4dae-80f5-7f5cf9665eec {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:35:07.102762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:07.127477 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cc19a00f-5f33-45e6-96cf-36c2eda39fcb tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1303 microversion: 2.1 time: 0.156490 Sep 02 04:35:07.128417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 487/981] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:06 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1303 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:07.322426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Action: 'create', calling method: .version_select at 0x7fa04b37fb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532203661"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:07.341771 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for project 517e94bc84864ab9ae4f9150a816973b. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:35:07.345863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for user 85544bf06b43412e840f5ce936f1dc68 and project 517e94bc84864ab9ae4f9150a816973b. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:35:07.381565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:07.382258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:07.389474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:07.391055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.392055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:07.392767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.560980 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:07.575417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4bf0dac9-2336-4dc4-a632-07d58caefb2d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.202216 Sep 02 04:35:07.576068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 488/982] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:07 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:07.580527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:07.581856 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:07.588101 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:07.599546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.599546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:07.599546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:07.689309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e2a1347d-c373-4696-a479-0fbd34ad67ad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28267 microversion: 2.20 time: 0.111754 Sep 02 04:35:07.693532 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 489/983] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:07 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:07.727623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for project 517e94bc84864ab9ae4f9150a816973b. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:35:07.731237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for user 85544bf06b43412e840f5ce936f1dc68 and project 517e94bc84864ab9ae4f9150a816973b. Resources: {'key_pairs'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:35:07.745647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cf5c2670-618c-4d61-b3b9-cf53b4f49663 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.542482 Sep 02 04:35:07.746238 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 495/984] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Sep 2 04:35:07 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:08.147296 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:08.148005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:08.155123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.155574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.156407 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.156868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.202057 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.202769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.203373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lazy-loading 'fault' on Instance uuid af9dbb48-2b3d-4dae-80f5-7f5cf9665eec {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:35:08.253662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:08.260652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-308698fc-6a83-47d5-bf66-80881fad2772 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 200 len: 1303 microversion: 2.1 time: 0.116692 Sep 02 04:35:08.270060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 490/985] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:08 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:08.592594 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:08.593334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:08.599506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.600034 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.600829 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.601268 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.701659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:08.702538 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:08.708752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.711404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.711404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:08.711404 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:08.742802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:08.750018 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ac0d1ab3-fa44-4f45-a981-61a833f55be2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.161175 Sep 02 04:35:08.750579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 496/986] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:08 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:08.795299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a242d534-73ef-4670-bd06-afd9724cb3ca tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28267 microversion: 2.20 time: 0.097132 Sep 02 04:35:08.799487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 491/987] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:08 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:09.281189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:09.281189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: af9dbb48-2b3d-4dae-80f5-7f5cf9665eec] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:09.286097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:09.286546 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:09.287315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:09.287746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:09.303238 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] HTTP exception thrown: Instance af9dbb48-2b3d-4dae-80f5-7f5cf9665eec could not be found. Sep 02 04:35:09.303839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Returning 404 to user: Instance af9dbb48-2b3d-4dae-80f5-7f5cf9665eec could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:35:09.305854 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9cc1270c-2cff-4398-9911-5ea6cb6e76d5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec" status: 404 len: 111 microversion: 2.1 time: 0.031189 Sep 02 04:35:09.306407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 497/988] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:09 2021] GET /compute/v2.1/servers/af9dbb48-2b3d-4dae-80f5-7f5cf9665eec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:35:09.466287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1334708930", "imageRef": "b367786b-9688-46d7-a78d-e84bff95622a", "flavorRef": "452", "networks": [{"uuid": "116d17e0-f7af-4097-899a-e7111647f627"}]}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:09.520927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.network.neutron [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] validate_networks() for [('116d17e0-f7af-4097-899a-e7111647f627', None, None, None, None, None)] {{(pid=108891) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:35:09.767152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:09.768367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:09.778847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:09.779694 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:09.780733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:09.781334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:10.005805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:10.016597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-013ca705-4cfa-417f-a3e6-1ff2a11dd243 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.252861 Sep 02 04:35:10.017942 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Flavor limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:35:10.018635 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Image limits 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:35:10.019137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Flavor pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:35:10.020136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Image pref 0:0:0 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:35:10.020279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 498/989] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:09 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:10.020858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.virt.hardware [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:35:10.030949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:10.032145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:10.033180 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:10.033622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:10.034599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:10.035232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:10.038531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:10.039210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:10.040237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:10.040849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:10.055157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Getting quotas for project 3db6fa006b6f47ee95cae83d696c4b8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:35:10.060098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Getting quotas for user 698c12a4ccef49d690bf2412c5ee6868 and project 3db6fa006b6f47ee95cae83d696c4b8d. Resources: {'ram', 'cores', 'instances'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:35:10.072230 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Going to run 1 instances... {{(pid=108891) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:35:10.075068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b367786b-9688-46d7-a78d-e84bff95622a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:35:10.158331 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e2510550-7d75-4eca-852b-e627c87545f8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28558 microversion: 2.20 time: 0.136592 Sep 02 04:35:10.158893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 499/990] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:10 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28558 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:10.219236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-20008e10-f8d5-4b31-83f9-02fa51919177 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756915 Sep 02 04:35:10.225093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 492/991] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:35:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:35:10.230635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-afb48ae0-9c4e-402e-a1eb-b2ce6a33ed4b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:10.231365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-afb48ae0-9c4e-402e-a1eb-b2ce6a33ed4b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:10.287320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-afb48ae0-9c4e-402e-a1eb-b2ce6a33ed4b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:10.295670 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-afb48ae0-9c4e-402e-a1eb-b2ce6a33ed4b tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1214 microversion: 2.1 time: 0.068615 Sep 02 04:35:10.296734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 500/992] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:10 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:11.034477 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:11.036808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:11.042239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.042686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.043451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.043885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.171649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:11.172289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:11.187048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.187496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.192040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.192487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.238336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:11.262392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f2c5624e-8482-4ae9-a28a-ad3b1cb4f6df tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.230732 Sep 02 04:35:11.262392 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 493/993] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:11 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:11.312581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:11.313582 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:11.329764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.329764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.329764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.329764 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.332379 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ac8d5740-caff-4cbf-8083-3941dadf3710 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28726 microversion: 2.20 time: 0.164713 Sep 02 04:35:11.337614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 501/994] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:11 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:35:11.420688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:11.427288 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a792db50-80a8-4c92-9b72-76367b9b8e50 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1218 microversion: 2.1 time: 0.118412 Sep 02 04:35:11.428162 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 494/995] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:11 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:11.539159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-233fd257-9190-4597-bf60-bdb2f0d11581 req-8d05e7ae-09f1-46de-b236-0b4c05858207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4704c6-71ce-41e9-a0e4-6945d86eac98", "name": "network-vif-plugged", "status": "completed", "tag": "30234d74-b9ed-48a4-ac77-9d01af5c2a78"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:11.540738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:11.540738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:35:11.548762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-233fd257-9190-4597-bf60-bdb2f0d11581 req-8d05e7ae-09f1-46de-b236-0b4c05858207 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:11.549347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-233fd257-9190-4597-bf60-bdb2f0d11581 req-8d05e7ae-09f1-46de-b236-0b4c05858207 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:11.562047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-233fd257-9190-4597-bf60-bdb2f0d11581 req-8d05e7ae-09f1-46de-b236-0b4c05858207 service nova] Creating event network-vif-plugged:30234d74-b9ed-48a4-ac77-9d01af5c2a78 for instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 on hv-cinder-80473 Sep 02 04:35:11.568007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-233fd257-9190-4597-bf60-bdb2f0d11581 req-8d05e7ae-09f1-46de-b236-0b4c05858207 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Sep 02 04:35:11.568619 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 502/996] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:12.278313 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:12.279047 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:12.294692 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.295195 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.296055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.296486 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.345445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:12.346521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:12.353239 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.353685 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.354455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.354900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.427652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:12.435504 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0881a362-235f-4d67-9329-79086311e4f3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.160993 Sep 02 04:35:12.436102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 495/997] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:12 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:12.445685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:12.446297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:12.452190 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.452639 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.453403 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:12.453868 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:12.470357 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9db27a37-1c41-4ae7-a724-6d5f76c1ec74 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28726 microversion: 2.20 time: 0.128922 Sep 02 04:35:12.471599 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 503/998] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:12 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28726 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:12.517377 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:12.524855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1fad27eb-2cba-4194-b14e-3a9a3f4f0208 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1266 microversion: 2.1 time: 0.083520 Sep 02 04:35:12.525426 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 496/999] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:12 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:13.453290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:13.453789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:13.461183 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.461627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.462507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.462937 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.483072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:13.484115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:13.493151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.493596 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.498031 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.498758 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.637995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0ce962b2-196f-49ea-9b33-808575e6ebb7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28726 microversion: 2.20 time: 0.158790 Sep 02 04:35:13.639999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 497/1000] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:13 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:13.641083 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:13.643774 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:13.644499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:13.650816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f7bbfb20-3f81-4b68-8ac3-c7e53b26f892 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1363 microversion: 2.1 time: 0.199913 Sep 02 04:35:13.650816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 504/1001] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:13 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:13.651103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.651282 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.652248 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:13.652674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:13.718318 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:13.726863 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-64eac206-f3e1-4a48-8666-a570ec180e0a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1272 microversion: 2.1 time: 0.086514 Sep 02 04:35:13.727430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 498/1002] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:13 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:14.650210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:14.651205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:14.658376 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.658376 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.658871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.659329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.665770 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:14.666588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:14.672671 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.673183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.674017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.674509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.752444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-00b62968-2bdd-400d-a3ad-2e3d5588bb3e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 28726 microversion: 2.20 time: 0.106372 Sep 02 04:35:14.753091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 505/1003] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:14 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 28726 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:14.758432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:14.759289 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:14.765742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.766215 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.766983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.767414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.900829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:14.904614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:14.921976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a820f30d-7a33-48a2-a1c6-e2e7eb4f1d23 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.158369 Sep 02 04:35:14.921976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 506/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:14 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:14.922222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a414b836-821f-4dbe-b418-4575434447cb tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1549 microversion: 2.1 time: 0.252807 Sep 02 04:35:14.922222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 499/1005] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:14 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1549 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:14.931775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:14.932340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:14.938036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.938476 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:14.939230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:14.939656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:15.020140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-af0af804-d74c-4ede-a9ee-c29903b091b3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092701 Sep 02 04:35:15.020762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 507/1006] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Sep 2 04:35:14 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:15.059631 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-d5efce6b-e8b5-4a3e-a0f2-559df24b6b0b req-69f32ebe-bc93-4365-97dd-948f794a7c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c84f09-204e-4ad7-a323-337e17848bc5", "tag": "3e48e06e-899a-4738-826c-7c1e0c5e3733"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:15.061256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:15.061256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:35:15.074514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-d5efce6b-e8b5-4a3e-a0f2-559df24b6b0b req-69f32ebe-bc93-4365-97dd-948f794a7c52 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:15.074944 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-d5efce6b-e8b5-4a3e-a0f2-559df24b6b0b req-69f32ebe-bc93-4365-97dd-948f794a7c52 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:15.089175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-d5efce6b-e8b5-4a3e-a0f2-559df24b6b0b req-69f32ebe-bc93-4365-97dd-948f794a7c52 service nova] Creating event network-changed:3e48e06e-899a-4738-826c-7c1e0c5e3733 for instance 66c84f09-204e-4ad7-a323-337e17848bc5 on hv-cinder-80473 Sep 02 04:35:15.094846 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-d5efce6b-e8b5-4a3e-a0f2-559df24b6b0b req-69f32ebe-bc93-4365-97dd-948f794a7c52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039500 Sep 02 04:35:15.095821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 500/1007] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:15.763858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:15.764928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:15.771843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:15.772624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:15.773990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:15.774420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:15.887603 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-419576a1-6e4f-4f6a-a95f-bb45dc0446f2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 30016 microversion: 2.20 time: 0.127354 Sep 02 04:35:15.889955 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 508/1008] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:15 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 30016 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:15.929945 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:15.930558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:15.936723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:15.937176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:15.937919 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:15.938354 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:16.063140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:16.070778 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e7abeb26-7f71-494e-a5ad-5cc259501e71 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.144933 Sep 02 04:35:16.071333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 501/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:15 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:16.257939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:16.258953 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:16.268139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:16.270409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:16.270409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:16.270409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:16.359054 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1190d24a-984e-4513-8c9f-a3e3a56a0732 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.110472 Sep 02 04:35:16.360089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 509/1010] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:16 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:16.463540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-224b5347-f140-4d27-8e57-eeb453bf277a req-3af579bc-5602-40fa-98cd-0ce3d09d9198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c4704c6-71ce-41e9-a0e4-6945d86eac98", "tag": "30234d74-b9ed-48a4-ac77-9d01af5c2a78"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:16.465133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:16.465133 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:35:16.473091 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-224b5347-f140-4d27-8e57-eeb453bf277a req-3af579bc-5602-40fa-98cd-0ce3d09d9198 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:16.473747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-224b5347-f140-4d27-8e57-eeb453bf277a req-3af579bc-5602-40fa-98cd-0ce3d09d9198 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:16.485380 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-224b5347-f140-4d27-8e57-eeb453bf277a req-3af579bc-5602-40fa-98cd-0ce3d09d9198 service nova] Creating event network-changed:30234d74-b9ed-48a4-ac77-9d01af5c2a78 for instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 on hv-cinder-80473 Sep 02 04:35:16.491173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-224b5347-f140-4d27-8e57-eeb453bf277a req-3af579bc-5602-40fa-98cd-0ce3d09d9198 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240780 Sep 02 04:35:16.492889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 502/1011] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:16.902946 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:16.905286 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:16.914624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:16.915069 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:16.915896 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:16.916358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:17.023079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a513272d-b54d-4df6-b0f2-59750eb64061 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 31522 microversion: 2.20 time: 0.125792 Sep 02 04:35:17.024970 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 510/1012] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:16 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 31522 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:17.089264 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:17.090662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:17.098489 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:17.099310 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:17.100425 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:17.101701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:17.323287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:17.331301 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-73955a1d-1a80-4393-9ed9-11197800dd8a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.246973 Sep 02 04:35:17.334806 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 503/1013] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:17 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:17.370523 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:17.372334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:17.380711 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:17.382235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:17.382983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:17.383571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:17.475810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-823e40b3-3905-4a82-8417-fd27f1f1e486 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.109383 Sep 02 04:35:17.479063 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 511/1014] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:17 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:18.035988 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:18.037362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:18.044258 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.044711 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.045496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.045925 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.144922 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e72f1a96-4fd1-43a0-96ca-4fe659e54a9a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 32860 microversion: 2.20 time: 0.112735 Sep 02 04:35:18.145561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 504/1015] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:18 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 32860 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:18.349536 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:18.350228 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:18.357135 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.357574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.358328 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.358754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.484009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:18.487723 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:18.488161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:18.493613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-77d02c8d-a025-4e01-8e3f-7d23e122a2b5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.148309 Sep 02 04:35:18.494189 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 512/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:18 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:18.495361 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.495812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.496745 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:18.497256 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:18.578815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-136cb92a-ab41-438d-839e-6edb7be1213c tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.095559 Sep 02 04:35:18.579465 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 505/1017] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:18 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:35:19.156652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:19.157592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:19.163410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.163856 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.164653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.165092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.261008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aeb7eb71-1bf5-47e5-a5b2-ce0ed0d8fac9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 33709 microversion: 2.20 time: 0.107851 Sep 02 04:35:19.261700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 513/1018] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:19 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 33709 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:19.511251 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:19.511982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:19.518659 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.519109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.519860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.520310 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.590689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:19.591874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:19.602678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.602678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.603140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:19.603572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:19.650202 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:19.652763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-a382c957-4ab9-4cc0-9345-30c71c5e4a3a tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.146300 Sep 02 04:35:19.653323 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 506/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:19 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:19.692584 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-771f0a5d-d8d4-4485-97a1-0b598534fcae tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.105864 Sep 02 04:35:19.693321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 514/1020] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:19 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:35:20.271932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:20.273339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:20.279828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.280477 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.281447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.281880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.377851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ad2a74cd-7e89-4a45-8c7a-49982baa1bba tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 34653 microversion: 2.20 time: 0.109457 Sep 02 04:35:20.378490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 507/1021] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:20 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 34653 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:20.670851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:20.671579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:20.678078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.678518 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.679273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.679701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.704154 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:20.705232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:20.712095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.712749 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.713746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:20.714420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:20.802746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:20.809890 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-67609c0e-0a10-485b-a970-3ca76b30e7a8 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.143645 Sep 02 04:35:20.810580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 515/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:20 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:20.818969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-60a7ad3f-a48c-48ef-8ba3-95e027244220 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.118631 Sep 02 04:35:20.819639 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 508/1023] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:20 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:35:21.390052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:21.390960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:21.396773 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.397217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.397979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.398411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.493005 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aebf9adb-09bf-4eb0-8abb-53823fbac023 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 35753 microversion: 2.20 time: 0.106428 Sep 02 04:35:21.493649 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 516/1024] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:21 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 35753 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:35:21.697895 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-3054a4cb-b159-4bf3-b401-e215c8be8868 req-f38527a5-251a-45eb-bd45-8448474ab798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c84f09-204e-4ad7-a323-337e17848bc5", "name": "network-vif-plugged", "status": "completed", "tag": "3e48e06e-899a-4738-826c-7c1e0c5e3733"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:21.699381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:21.699381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:35:21.706272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-3054a4cb-b159-4bf3-b401-e215c8be8868 req-f38527a5-251a-45eb-bd45-8448474ab798 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.706851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-3054a4cb-b159-4bf3-b401-e215c8be8868 req-f38527a5-251a-45eb-bd45-8448474ab798 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.717954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-3054a4cb-b159-4bf3-b401-e215c8be8868 req-f38527a5-251a-45eb-bd45-8448474ab798 service nova] Creating event network-vif-plugged:3e48e06e-899a-4738-826c-7c1e0c5e3733 for instance 66c84f09-204e-4ad7-a323-337e17848bc5 on hv-cinder-80473 Sep 02 04:35:21.723032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-3054a4cb-b159-4bf3-b401-e215c8be8868 req-f38527a5-251a-45eb-bd45-8448474ab798 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210188 Sep 02 04:35:21.723655 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 509/1025] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:21.827762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:21.830035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:21.830151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:21.830918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:21.835050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.835507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.836321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.836815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.837028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.837479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.838263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:21.838688 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:21.924334 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-61fb444c-23ec-4d83-a7ca-4c6609d489a1 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.097891 Sep 02 04:35:21.930226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 510/1026] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:21 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 04:35:21.960064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:21.967376 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8847138b-5ef1-4bfd-ae60-62117ac88122 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.143833 Sep 02 04:35:21.967971 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 517/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:21 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:22.506232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:22.507335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:22.514053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.514561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:22.515316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.515735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:22.617519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3c4af0c3-1cf0-4390-a20f-668f2e216211 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 37076 microversion: 2.20 time: 0.115840 Sep 02 04:35:22.618160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 511/1028] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:22 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 37076 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:35:22.935974 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:22.936911 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:22.943087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.943532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:22.944323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.944755 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:22.983629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:22.984460 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:22.991637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.992120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:22.992902 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:22.993326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:23.060384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1e80fe6d-b3c6-4a31-b2d4-99a74b3eaac3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.127770 Sep 02 04:35:23.063339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 518/1029] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:22 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:23.116114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:23.123879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-97b68326-f0fb-4ad2-bf31-ab8fcaa3223c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1314 microversion: 2.1 time: 0.144146 Sep 02 04:35:23.124471 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 512/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:22 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:23.629849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:23.630966 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:23.638861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:23.639336 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:23.640161 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:23.640589 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:23.743825 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dc44320d-befa-4cb7-be41-5ed5941dbddf tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 38095 microversion: 2.20 time: 0.117120 Sep 02 04:35:23.744502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 519/1031] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:23 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 38095 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:24.070434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:24.071340 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:24.077545 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.077978 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.078730 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.079151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.141108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:24.141751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:24.148146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.148594 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.149877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.150311 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.160700 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bd6c345b-e8fe-4d2e-a155-baf5d208fd0f tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.093645 Sep 02 04:35:24.163888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 513/1032] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:24 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:24.274996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:24.282270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7e78f4a0-f622-41f6-bf1f-72fab97baa5c tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1498 microversion: 2.1 time: 0.145310 Sep 02 04:35:24.282840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 520/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:24 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:24.755848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:24.758479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:24.763042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.763578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.764259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:24.764685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:24.860527 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0c3d349f-dc15-44a6-9080-94b94f938c5e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 38282 microversion: 2.20 time: 0.108445 Sep 02 04:35:24.861405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 514/1034] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:24 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 38282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:25.171797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:25.172762 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:25.179073 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.179585 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.180356 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.181364 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.266690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e436cafc-4301-4e99-8db3-94026db62740 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.098393 Sep 02 04:35:25.267226 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 521/1035] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:25 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:25.333067 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:25.333696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:25.340584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.341022 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.341773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.342199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.366267 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:35:25.636566 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c3a27bd1-3d51-4c73-b419-b9091c8b3d20 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 204 len: 0 microversion: 2.1 time: 0.307041 Sep 02 04:35:25.637085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 515/1036] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:35:25 2021] DELETE /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:35:25.645710 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:25.646408 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:25.653270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.653713 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.654462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.654893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.771432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:25.779259 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cc4697a4-c74c-4772-a46e-10b52ea0f1db tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1504 microversion: 2.1 time: 0.137584 Sep 02 04:35:25.779820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 522/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:25 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1504 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:25.872694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:25.873763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:25.879483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.879936 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.880690 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:25.881110 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:25.969043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-02ce9aef-fc7a-46f3-9e61-77b1e318760a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 38282 microversion: 2.20 time: 0.100142 Sep 02 04:35:25.970250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 516/1038] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:25 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 38282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:26.277122 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:26.278030 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:26.283839 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.284313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:26.285096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.285526 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:26.375635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-aae3f810-4aa0-4c01-9a80-8d6511f8cd58 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.102082 Sep 02 04:35:26.376262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 523/1039] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:26 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:26.797326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:26.798003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:26.804447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.804882 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:26.805632 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.806053 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:26.922784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:26.930048 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3edddab2-1076-4a6e-a1b3-b9a95202be72 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1504 microversion: 2.1 time: 0.136721 Sep 02 04:35:26.930640 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 517/1040] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:26 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1504 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:26.982498 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:26.983493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:26.989812 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.990252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:26.991006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:26.991452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:27.108086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-83ae3842-0870-4e39-8176-dbba0c2becd6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 38298 microversion: 2.20 time: 0.130087 Sep 02 04:35:27.108708 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 524/1041] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:26 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 38298 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:35:27.386834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:27.387737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:27.393393 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:27.393824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:27.394569 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:27.394989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:27.540246 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9a729ba3-bf5d-4747-b3dd-54077642b2d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.157400 Sep 02 04:35:27.540880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 518/1042] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:27 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:27.947058 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:27.947673 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:27.954210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:27.954652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:27.955411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:27.955837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.026131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:28.037279 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-e00dc138-d918-4e22-bca1-5a37b3bd474d req-e8778c66-d2c8-4e2e-93fa-342c10e9e7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c84f09-204e-4ad7-a323-337e17848bc5", "name": "network-vif-deleted", "tag": "3e48e06e-899a-4738-826c-7c1e0c5e3733"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:28.037803 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6bf69e58-bab1-468b-b4d3-2f8746819fe1 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1462 microversion: 2.1 time: 0.094775 Sep 02 04:35:28.038300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 525/1043] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:27 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1462 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:28.038847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:28.038847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:35:28.047223 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-e00dc138-d918-4e22-bca1-5a37b3bd474d req-e8778c66-d2c8-4e2e-93fa-342c10e9e7d6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.047668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-e00dc138-d918-4e22-bca1-5a37b3bd474d req-e8778c66-d2c8-4e2e-93fa-342c10e9e7d6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.059341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-e00dc138-d918-4e22-bca1-5a37b3bd474d req-e8778c66-d2c8-4e2e-93fa-342c10e9e7d6 service nova] Creating event network-vif-deleted:3e48e06e-899a-4738-826c-7c1e0c5e3733 for instance 66c84f09-204e-4ad7-a323-337e17848bc5 on hv-cinder-80473 Sep 02 04:35:28.064489 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-e00dc138-d918-4e22-bca1-5a37b3bd474d req-e8778c66-d2c8-4e2e-93fa-342c10e9e7d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Sep 02 04:35:28.065068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 519/1044] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:35:28.119743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:28.120681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:28.126724 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.127179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.127976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.128414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.215205 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cd71dd1d-b90b-443c-bd6d-748e350e69a2 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 200 len: 38423 microversion: 2.20 time: 0.098970 Sep 02 04:35:28.215761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 526/1045] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:28 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 38423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:35:28.226201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:28.226767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:28.233070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.233508 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.234270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.234676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.273080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8b179273-910f-49eb-ac5d-ba12c03ce216 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/ips" status: 200 len: 152 microversion: 2.20 time: 0.051087 Sep 02 04:35:28.273703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 520/1046] 10.222.0.13 () {60 vars in 1289 bytes} [Thu Sep 2 04:35:28 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:28.551510 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:28.552525 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:28.559397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.559837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.560616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:28.561042 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:28.650325 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cbb597d5-68e2-4a4a-aa78-3d74f38c1e24 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 14 microversion: 2.1 time: 0.102753 Sep 02 04:35:28.650979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 527/1047] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:28 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:35:29.054558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:29.055301 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:29.061546 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:29.062001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:29.062734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:29.063160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:29.093401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:29.093835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:29.094271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lazy-loading 'fault' on Instance uuid 66c84f09-204e-4ad7-a323-337e17848bc5 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:35:29.134312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698c12a4ccef49d690bf2412c5ee6868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db6fa006b6f47ee95cae83d696c4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:29.141599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cf2a2ff0-b297-4ff2-9dd7-cfa0eba164f5 tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 200 len: 1304 microversion: 2.1 time: 0.090748 Sep 02 04:35:29.142558 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 521/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:29 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:29.661071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:29.662052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:29.668373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:29.668816 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:29.669561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:29.669989 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:29.750774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-be69fc0c-aa3a-4ed1-bcf4-30adad50ed07 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 6451 microversion: 2.1 time: 0.093660 Sep 02 04:35:29.751403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 528/1049] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:29 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 6451 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:30.159349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:30.160098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] [instance: 66c84f09-204e-4ad7-a323-337e17848bc5] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:30.166376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.166821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.167572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.168026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.181130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] HTTP exception thrown: Instance 66c84f09-204e-4ad7-a323-337e17848bc5 could not be found. Sep 02 04:35:30.182284 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] Returning 404 to user: Instance 66c84f09-204e-4ad7-a323-337e17848bc5 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:35:30.183101 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-342b924e-b506-4ef6-8792-bce7ecbaa1af tempest-VolumesActionsTest-2119125279 tempest-VolumesActionsTest-2119125279-project] 10.222.0.13 "GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5" status: 404 len: 111 microversion: 2.1 time: 0.027500 Sep 02 04:35:30.183634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 522/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:30 2021] GET /compute/v2.1/servers/66c84f09-204e-4ad7-a323-337e17848bc5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:35:30.226106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1279874613", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1532203661", "security_groups": [{"name": "tempest-secgroup-smoke-1205580763"}], "networks": [{"uuid": "5bfa45e8-237f-4771-91ff-dea054465f36"}], "block_device_mapping_v2": [{"uuid": "35818d57-cf6d-4131-9ca7-9239324dd2d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:30.330417 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] validate_networks() for [('5bfa45e8-237f-4771-91ff-dea054465f36', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:35:30.693304 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:35:30.693863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:35:30.694213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:35:30.694616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:35:30.695026 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:35:30.704166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.704614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.705409 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.705837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.721393 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for project 517e94bc84864ab9ae4f9150a816973b. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:35:30.725486 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Getting quotas for user 85544bf06b43412e840f5ce936f1dc68 and project 517e94bc84864ab9ae4f9150a816973b. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:35:30.761702 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:30.762613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:30.769507 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.770013 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.770804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.771249 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.786169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:35:30.788426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35818d57-cf6d-4131-9ca7-9239324dd2d0',volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:35:30.872168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c58635af-0e54-4ed1-8c2b-7e906168bcfd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 15025 microversion: 2.1 time: 0.114433 Sep 02 04:35:30.872804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 523/1051] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:30 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 15025 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:30.877787 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:30.878399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:30.885533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.885974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.886737 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:30.887164 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:30.908909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'flavor' on Instance uuid 0164b812-ed22-4e84-88e6-93e328601f53 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:35:31.247173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f5a377a2-cb63-4ebc-bae4-bb149bcbafd3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025187 Sep 02 04:35:31.247799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 529/1052] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:35:30 2021] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:35:31.257310 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0a764a0f-25a4-4339-9122-20c59f754c3b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:31.258044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0a764a0f-25a4-4339-9122-20c59f754c3b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:31.329809 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0a764a0f-25a4-4339-9122-20c59f754c3b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:31.352903 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0a764a0f-25a4-4339-9122-20c59f754c3b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1089 microversion: 2.1 time: 0.099122 Sep 02 04:35:31.354058 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 530/1053] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:31 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1089 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:31.430613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2427c42e-549d-4f95-9cd3-a410ce6c6997 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 202 len: 0 microversion: 2.20 time: 0.556335 Sep 02 04:35:31.433319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 524/1054] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:35:30 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:35:31.439331 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:31.440168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:31.446243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:31.446888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:31.447663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:31.448123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:31.574654 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:31.582764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:31.584309 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:31.585590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-78b61c49-b608-44f6-859e-f14be24de1ab tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.149972 Sep 02 04:35:31.586142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 531/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:31 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:31.883668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:31.885306 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:31.891708 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:31.892175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:31.892974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:31.893402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:32.370377 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:32.370997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:32.376866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:32.377314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:32.378070 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:32.378503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:32.436145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:32.443191 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7351d617-04f4-4c07-8b67-cf0d0d957934 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1139 microversion: 2.1 time: 0.077162 Sep 02 04:35:32.443748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 532/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:32 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1139 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:32.604550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:32.605192 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:32.610988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:32.611438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:32.612221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:32.612657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:32.727086 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:32.735109 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:32.736637 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:32.737778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-04aae22c-2de3-4b32-b7cb-fe5f9ad9916f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.137568 Sep 02 04:35:32.738333 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 533/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:32 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:35:33.459420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:33.460070 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:33.466892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:33.467350 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:33.468121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:33.468581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:33.528441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:33.535575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5a397179-eda6-4f62-8808-c9e87c305090 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1139 microversion: 2.1 time: 0.079821 Sep 02 04:35:33.536167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 534/1058] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:33 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:35:33.755652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:33.756281 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:33.762652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:33.763097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:33.763844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:33.764295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:33.879227 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:33.887443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:33.889015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:33.890159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-73260d4f-b09c-442b-a7ac-0cd352ed2dcc tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.138202 Sep 02 04:35:33.890721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 535/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:33 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:35:34.466916 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-58f9724d-e891-4c60-9751-90c9066d9018 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 22897 microversion: 2.1 time: 2.587132 Sep 02 04:35:34.467831 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 525/1060] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:31 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 22897 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:34.551084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:34.551647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:34.557445 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:34.557883 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:34.558668 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:34.559099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:34.616378 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:34.623372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b65e23ef-131e-48be-b76e-2e359bb781ce tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1139 microversion: 2.1 time: 0.076277 Sep 02 04:35:34.623940 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 536/1061] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:34 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1139 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:34.908762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:34.909463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:34.915854 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:34.917808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:34.917808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:34.917808 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:35.037551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:35.045338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:35.046827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:35.048032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8ff10a4d-84c0-4a2d-8cca-adf2e0cd1758 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.143400 Sep 02 04:35:35.048858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 526/1062] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:34 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:35.479090 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:35.484948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:35.487097 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:35.487574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:35.488358 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:35.488958 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:35.584994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-952c2b31-6850-4279-abba-b5851f6ad32d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 23804 microversion: 2.1 time: 0.109901 Sep 02 04:35:35.585629 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 537/1063] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:35 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 23804 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:35.638458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:35.639055 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:35.645120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:35.645554 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:35.646304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:35.646726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:35.733307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:35.740987 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1889aaa9-3b08-486c-90d2-faa76fae6d76 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1195 microversion: 2.1 time: 0.106127 Sep 02 04:35:35.741866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 527/1064] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:35 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:36.073221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:36.077126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:36.091181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.091635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.092547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.100347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.263178 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:36.288473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:36.290443 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:36.296335 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e4d2ebe8-d513-4579-997e-82a11e66565f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.231992 Sep 02 04:35:36.307441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 538/1065] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:36 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:35:36.601498 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:36.604102 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:36.635615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.636205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.641107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.641687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.748553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-28865ce1-2fd6-42fa-bb1e-bebf2673b62a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 25339 microversion: 2.1 time: 0.155262 Sep 02 04:35:36.749686 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 528/1066] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:36 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 25339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:36.758994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:36.760462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:36.767106 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.767778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.768817 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:36.769468 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:36.961613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:36.970612 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9c840bf5-9acf-4eca-b0f2-18036933fb98 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1273 microversion: 2.1 time: 0.215723 Sep 02 04:35:36.973885 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 539/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:36 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:37.329089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:37.329908 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:37.336733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:37.338054 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:37.339084 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:37.340028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:37.733518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:37.743026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:37.744932 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:37.746117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7f0b20e4-f7b8-4b21-94c0-1c3076b78b42 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.421479 Sep 02 04:35:37.746739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 529/1068] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:37 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:37.760763 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:37.762428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:37.769577 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:37.770451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:37.771467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:37.772267 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:37.871483 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-69c36af4-9288-4708-bcbc-c998ffbee045 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 26371 microversion: 2.1 time: 0.114722 Sep 02 04:35:37.873075 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 540/1069] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:37 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 26371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:37.990302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:37.991123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:37.999297 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.000135 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.001094 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.001707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.160338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:38.187283 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-908144f8-f3fb-45cd-9dc6-7c0127ae2a91 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1273 microversion: 2.1 time: 0.200058 Sep 02 04:35:38.198984 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 530/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:37 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:38.223377 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-dadb0d0f-37cc-493b-880b-dd345784c849 req-79eeb29b-40ac-4e2e-a7d3-d8b50071ef40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:38.225386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:38.225386 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:35:38.236104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-dadb0d0f-37cc-493b-880b-dd345784c849 req-79eeb29b-40ac-4e2e-a7d3-d8b50071ef40 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.237406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-dadb0d0f-37cc-493b-880b-dd345784c849 req-79eeb29b-40ac-4e2e-a7d3-d8b50071ef40 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.262493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-dadb0d0f-37cc-493b-880b-dd345784c849 req-79eeb29b-40ac-4e2e-a7d3-d8b50071ef40 service nova] Creating event network-changed:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:35:38.267449 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-dadb0d0f-37cc-493b-880b-dd345784c849 req-79eeb29b-40ac-4e2e-a7d3-d8b50071ef40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049158 Sep 02 04:35:38.268840 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 541/1071] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:38.769883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:38.770580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:38.779032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.779032 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.780356 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.781634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.883523 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:38.884977 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:38.891686 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.892159 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.892947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:38.893571 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:38.995331 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-217cc8b0-5e9e-42ee-8696-70aa3ceea077 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 27356 microversion: 2.1 time: 0.115748 Sep 02 04:35:38.996574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 542/1072] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:38 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 27356 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:39.013410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:39.021192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:39.022763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:39.024389 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-65847ced-20fa-4325-8bad-d9c589df734f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.258869 Sep 02 04:35:39.025511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 531/1073] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:38 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:39.205604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:39.206303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:39.214902 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:39.215352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:39.216152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:39.216591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:39.349391 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:39.357001 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-39a2dd38-a476-4d45-9dc9-430b85f865e4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.156058 Sep 02 04:35:39.357581 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 543/1074] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:39 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:40.006626 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:40.007851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:40.013800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.014490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.015475 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.016004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.045663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:40.045663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:40.053540 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.053988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.054751 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.055179 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.126507 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3056bc7e-b89e-4ba6-96b2-804b035063ab tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 27835 microversion: 2.1 time: 0.123264 Sep 02 04:35:40.127888 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 532/1075] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:40 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 27835 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:35:40.185196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:40.193960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:40.195473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:40.197355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1e7ad624-56cb-4256-9ed2-5474790aa203 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.155552 Sep 02 04:35:40.197968 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 544/1076] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:40 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:35:40.374644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:40.375462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:40.382336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.382851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.383676 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:40.384753 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:40.517136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:40.525627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-12b9f31f-a70b-4c4e-b262-a73b108311f5 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.154360 Sep 02 04:35:40.527050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 533/1077] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:40 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:41.138516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:41.139665 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:41.146336 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.146876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.147941 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.148480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.216568 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:41.218605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:41.225483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.226206 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.227162 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.229112 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.258833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-80b69ea4-23c0-4dd9-baa5-686d3672613b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28203 microversion: 2.1 time: 0.123707 Sep 02 04:35:41.259742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 545/1078] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:41 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28203 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:41.400702 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:41.412372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:41.414429 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:41.416989 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4af6985b-d225-4d43-b491-265cf7934a32 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.206198 Sep 02 04:35:41.418267 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 534/1079] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:41 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:35:41.543521 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:41.544493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:41.551743 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.552345 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.553141 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:41.553698 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:41.690059 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:41.698092 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-31bcd64a-f62f-4e9a-a143-f6de4f889db3 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.159163 Sep 02 04:35:41.698692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 546/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:41 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:42.270644 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:42.271547 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:42.278588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.279416 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.280408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.280836 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.386237 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e6da2bb7-4832-40af-b559-95fe834a890a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28203 microversion: 2.1 time: 0.119045 Sep 02 04:35:42.387056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 535/1081] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:42 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28203 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:42.436870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:42.437564 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:42.444837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.445644 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.447203 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.447706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.586462 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:42.596534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:42.598664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:42.599870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d70aacaf-fc80-419e-8498-bd73d7d1062f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.167649 Sep 02 04:35:42.603952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 547/1082] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:42 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:42.717017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:42.717704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:42.725458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.726202 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.727074 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:42.727565 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:42.875564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:42.884757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-01a1ebf0-4592-41cf-892d-6022980f0d3d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.172704 Sep 02 04:35:42.885468 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 536/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:42 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:43.401162 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:43.402553 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:43.412203 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.412871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:43.413925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.414662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:43.522390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-436083ad-4117-4595-9cf8-5e671c1bb5ce tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28348 microversion: 2.1 time: 0.125924 Sep 02 04:35:43.523741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 548/1084] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:43 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:43.624224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:43.625599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:43.632026 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.639951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:43.639951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.639951 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:43.765473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:43.773828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:43.776183 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:43.777645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4a69e30b-9695-4c36-8390-19151bed52d3 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.157242 Sep 02 04:35:43.778398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 537/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:43 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:43.902079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:43.902832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:43.909630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.910085 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:43.910847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:43.911283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:44.044709 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:44.052339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4e5654ca-e262-4830-b56e-2a583dd02ec9 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.154591 Sep 02 04:35:44.061503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 549/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:43 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:44.535537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:44.536554 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:44.544338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:44.544731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:44.545551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:44.545987 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:44.641509 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fe504c6c-aaf2-4330-b0f9-95099fe01082 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28494 microversion: 2.1 time: 0.108618 Sep 02 04:35:44.644999 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 538/1087] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:44 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28494 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:35:44.797464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:44.798167 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:44.804317 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:44.804759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:44.805528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:44.805952 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:44.934995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:44.942868 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:44.944440 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:44.945618 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-097d216f-3d0f-4fc5-8fd5-97fde551fa38 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.151964 Sep 02 04:35:44.946170 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 550/1088] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:44 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:45.069393 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:45.070028 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:45.076752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.077190 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:45.077936 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.078362 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:45.200131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:45.207653 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e1655241-e5d1-4e30-976e-badffb639bc4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.142750 Sep 02 04:35:45.208245 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 539/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:45 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:45.653242 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:45.654217 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:45.660407 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.660847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:45.661639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.662026 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:45.767000 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b0217380-1278-4368-a5f4-765d4a0d43d6 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28662 microversion: 2.1 time: 0.117682 Sep 02 04:35:45.771295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 551/1090] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:45 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28662 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:35:45.966512 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:45.967074 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:45.973637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.974078 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:45.974841 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:45.975267 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:46.097971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:46.106827 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:46.108409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:46.109517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f5845049-e7bf-4b83-b2ee-e1c1d37f5171 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.149820 Sep 02 04:35:46.110062 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 540/1091] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:45 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:46.226266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:46.226940 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:46.233992 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:46.234434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:46.235564 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:46.235956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:46.365726 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:46.374064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-263eb8e2-bc49-4009-a4d2-7f06951c0df6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.152478 Sep 02 04:35:46.374620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 552/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:46 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:46.779003 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:46.779966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:46.786360 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:46.786809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:46.787562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:46.788016 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:46.887338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d73b9e22-aea3-4941-b6e1-f43eaa93bbee tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28662 microversion: 2.1 time: 0.112292 Sep 02 04:35:46.891188 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 541/1093] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:46 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:47.127021 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:47.127543 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:47.133805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.134799 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:47.135528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.135976 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:47.264451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:47.275624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:47.280121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:47.280121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ff62065f-33cd-4ba1-beea-fcf7226b8a7f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.155119 Sep 02 04:35:47.280121 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 553/1094] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:47 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:47.391968 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:47.392668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:47.399670 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.400217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:47.401229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.401872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:47.563113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:47.572240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-227c0749-68e7-4bb8-b8fc-f4ada75c3f55 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.184428 Sep 02 04:35:47.581722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 542/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:47 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:47.898763 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:47.900224 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:47.906117 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.906568 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:47.907563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:47.907757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:48.001480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c36ec199-ae2c-4ae7-9876-5887881864f9 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28662 microversion: 2.1 time: 0.106241 Sep 02 04:35:48.002137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 554/1096] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:47 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:35:48.299207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:48.299822 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:48.305918 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:48.306368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:48.307212 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:48.307687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:48.456462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:48.468789 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:48.471116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:48.472754 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-436dfa01-2507-4307-b832-0348346e2793 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1744 microversion: 2.20 time: 0.177601 Sep 02 04:35:48.473828 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 543/1097] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:48 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:48.589219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:48.590525 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:48.597645 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:48.598164 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:48.599008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:48.599441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:48.726469 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:48.733941 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fe59582b-223b-423f-888c-e9ac20ea7f8b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.148923 Sep 02 04:35:48.734509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 555/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:48 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:49.013889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:49.015044 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:49.021075 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.021604 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.022461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.022974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.135540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-611e9654-6f73-4456-8692-0a13130fef8b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 28662 microversion: 2.1 time: 0.125086 Sep 02 04:35:49.136906 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 544/1099] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:49 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 28662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:49.490597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:49.491388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:49.502600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.503057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.506611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.506611 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.654923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:49.665229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:49.666811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:49.668088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5d7d523c-2b44-4ca3-aa24-7cef42a191ed tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1744 microversion: 2.20 time: 0.181292 Sep 02 04:35:49.669330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 556/1100] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:49 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:49.751515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:49.753017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:49.762266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.763809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.765766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.766448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.920884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-5294702b-c328-40e3-9cd4-ed6f9e69d7b9 req-fa69be2b-dc60-4f5e-8b69-62ad699b9cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "name": "network-vif-plugged", "status": "completed", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:49.923367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:49.923367 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:35:49.923603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:49.932042 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-41b7ad42-f721-423f-9fb8-83a3eab9c891 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.184921 Sep 02 04:35:49.934396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 545/1101] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:49 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:49.948842 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-5294702b-c328-40e3-9cd4-ed6f9e69d7b9 req-fa69be2b-dc60-4f5e-8b69-62ad699b9cf1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:49.950390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-5294702b-c328-40e3-9cd4-ed6f9e69d7b9 req-fa69be2b-dc60-4f5e-8b69-62ad699b9cf1 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:49.970837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-5294702b-c328-40e3-9cd4-ed6f9e69d7b9 req-fa69be2b-dc60-4f5e-8b69-62ad699b9cf1 service nova] Creating event network-vif-plugged:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:35:49.980093 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-5294702b-c328-40e3-9cd4-ed6f9e69d7b9 req-fa69be2b-dc60-4f5e-8b69-62ad699b9cf1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064950 Sep 02 04:35:49.984507 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 557/1102] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:35:50.147790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:50.148755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:50.161976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.162675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:50.164458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.165652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:50.273878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ed8e3722-2ac6-4abf-a6ae-e1526d66612d tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 29212 microversion: 2.1 time: 0.130250 Sep 02 04:35:50.280127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 546/1103] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:50 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 29212 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:50.689578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:50.690814 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:50.700522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.701152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:50.702277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.702895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:50.847936 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:50.856365 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:50.858006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:50.859273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-73943e1a-04f9-489b-8169-227a0738baad tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.176004 Sep 02 04:35:50.859949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 558/1104] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:50 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:50.950775 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:50.952451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:50.959862 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.960758 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:50.961927 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:50.962585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:51.135109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:51.146831 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3fb4edc4-94a9-48fb-8e25-4283c6e5df06 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1261 microversion: 2.1 time: 0.200501 Sep 02 04:35:51.147417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 547/1105] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:50 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:51.291656 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:51.293049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:51.305363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:51.306123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:51.307975 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:51.308403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:51.437463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6bebeec5-40de-444a-a325-95b216ecd419 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 30916 microversion: 2.1 time: 0.152767 Sep 02 04:35:51.442254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 559/1106] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:51 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 30916 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:51.878369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:51.878990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:51.895490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:51.895797 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:51.896784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:51.897378 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.001419 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-cb713f62-37ab-43c7-b7f0-ec768b6ac4bb req-35472bde-e01c-41c0-b9a8-194aa7396f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "name": "network-vif-plugged", "status": "completed", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:52.003014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:52.003014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:35:52.012240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-cb713f62-37ab-43c7-b7f0-ec768b6ac4bb req-35472bde-e01c-41c0-b9a8-194aa7396f5a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.012663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-cb713f62-37ab-43c7-b7f0-ec768b6ac4bb req-35472bde-e01c-41c0-b9a8-194aa7396f5a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.038451 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-cb713f62-37ab-43c7-b7f0-ec768b6ac4bb req-35472bde-e01c-41c0-b9a8-194aa7396f5a service nova] Creating event network-vif-plugged:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:35:52.045631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-cb713f62-37ab-43c7-b7f0-ec768b6ac4bb req-35472bde-e01c-41c0-b9a8-194aa7396f5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048585 Sep 02 04:35:52.046254 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 560/1107] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:52.106217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:52.115584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:52.118370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:52.120002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cd35518a-b6bf-4e24-9904-b7d6ca37b457 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.245278 Sep 02 04:35:52.132496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 548/1108] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:51 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:52.164177 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:52.164908 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:52.171235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.171691 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.172503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.172935 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.345063 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:52.353948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1e87251f-7c68-485b-8371-13b69f9491a4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1446 microversion: 2.1 time: 0.193664 Sep 02 04:35:52.354474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 561/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:52 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1446 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:52.371160 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:52.372278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:52.379845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.380462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.381579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.382091 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.452659 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:52.453580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:52.464919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.465632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.466761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:52.467041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:52.520755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:52.528810 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-576470b6-5519-477e-9fd8-ed6a908b6cc0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1446 microversion: 2.1 time: 0.161545 Sep 02 04:35:52.542811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 549/1110] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:35:52 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:35:52.576239 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a3cd231e-5df7-4f5b-bd1c-43a01599fed3 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 32409 microversion: 2.1 time: 0.127866 Sep 02 04:35:52.581722 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 562/1111] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:52 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 32409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:53.143190 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:53.144658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:53.156090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:53.156537 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:53.161396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:53.162601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:53.317114 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:53.326182 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:53.327848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:53.329039 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6f1ff041-fe4f-49dd-a61d-f5cfd3881cf5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.191923 Sep 02 04:35:53.329755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 550/1112] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:53 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:53.587901 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:53.588926 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:53.595444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:53.595859 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:53.596822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:53.597105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:53.691102 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c19d4352-b87e-48e5-9719-ca6e30a469d5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 33416 microversion: 2.1 time: 0.106987 Sep 02 04:35:53.691770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 563/1113] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:53 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 33416 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:54.346991 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:54.347937 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:54.354635 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:54.355089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:54.355887 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:54.356415 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:54.484504 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:54.500886 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:54.502496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:54.503694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c2c92cda-bca7-4de9-873e-222fe8773f09 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.160359 Sep 02 04:35:54.504483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 551/1114] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:54 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:54.703096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:54.704118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:54.710264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:54.710706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:54.711474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:54.712459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:54.827430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eb9a6815-e628-490b-b396-1c9663988936 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 34383 microversion: 2.1 time: 0.128086 Sep 02 04:35:54.832374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 564/1115] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:54 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 34383 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:55.326557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-b07fc4d2-0573-407f-ae71-63946d3d2e14 req-41297200-0804-4930-aec3-5236957ad3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:55.328341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:35:55.328341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:35:55.336189 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b07fc4d2-0573-407f-ae71-63946d3d2e14 req-41297200-0804-4930-aec3-5236957ad3bf service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:55.337411 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b07fc4d2-0573-407f-ae71-63946d3d2e14 req-41297200-0804-4930-aec3-5236957ad3bf service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:55.349961 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-b07fc4d2-0573-407f-ae71-63946d3d2e14 req-41297200-0804-4930-aec3-5236957ad3bf service nova] Creating event network-changed:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:35:55.355714 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-b07fc4d2-0573-407f-ae71-63946d3d2e14 req-41297200-0804-4930-aec3-5236957ad3bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032912 Sep 02 04:35:55.360235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 552/1116] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:35:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:35:55.525071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:55.526140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:55.535201 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:55.536514 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:55.537576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:55.538165 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:55.743559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:55.755076 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:55.758074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:55.759769 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2a217af7-fdd9-4c29-a051-b27484399068 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.241745 Sep 02 04:35:55.760870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 565/1117] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:55 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:55.841168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:55.842777 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:55.854145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:55.856213 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:55.859490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:55.860290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:55.979476 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-02462fe4-a0e9-4d8f-8d41-07960506f51b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 35470 microversion: 2.1 time: 0.143267 Sep 02 04:35:55.985185 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 553/1118] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:55 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 35470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:56.777690 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:56.778631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:56.787198 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:56.790862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:56.791837 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:56.793113 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:56.950962 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:56.965489 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:56.970108 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:56.971563 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-64f2c52e-9b4d-4c6e-850d-39b51b4bcff4 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.197690 Sep 02 04:35:56.985764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 566/1119] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:56 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:56.992625 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:56.994238 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:57.001013 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:57.001758 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:57.002792 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:57.003290 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:57.117597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-7f939f2d-d52b-462c-a990-ef066589274b tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 36860 microversion: 2.1 time: 0.128749 Sep 02 04:35:57.118969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 554/1120] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:56 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 36860 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:57.993620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:57.994229 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:58.000124 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:58.000564 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:58.001315 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:58.001740 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:58.119574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:58.127381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:58.128943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:58.130136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ffb0d38b-d51c-4f00-9250-f4d6e346c57e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.140893 Sep 02 04:35:58.130383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:58.130851 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 567/1121] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:57 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:35:58.131381 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:58.138487 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:58.138866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:58.139615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:58.140137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:58.231956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4fec03b3-b87b-4ba1-9d3e-8e75b9a9f545 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 38194 microversion: 2.1 time: 0.105342 Sep 02 04:35:58.232614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 555/1122] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:58 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 38194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:35:59.150807 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:35:59.151430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:59.161993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:59.162434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:59.163257 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:59.163682 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:59.246093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:35:59.249539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:35:59.259759 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:59.260488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:59.262125 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:35:59.262709 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:35:59.373220 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:59.382175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-faf6c909-de55-4002-8252-385824d7ab34 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 38194 microversion: 2.1 time: 0.140918 Sep 02 04:35:59.388614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 556/1123] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:35:59 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 38194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:35:59.395556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:59.397188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:35:59.398764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9e741d53-e758-489e-82f1-f6d1c779ed8a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.252755 Sep 02 04:35:59.399436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 568/1124] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:35:59 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:00.395282 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:00.396684 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:00.403735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:00.404410 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:00.405343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:00.406581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:00.422221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:00.423961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:00.432020 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:00.434161 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:00.435027 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:00.436292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:00.515052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3b430916-635e-415c-90fb-ef149d297cf7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 38194 microversion: 2.1 time: 0.123476 Sep 02 04:36:00.515696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 557/1125] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:36:00 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 38194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:36:00.586948 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:00.596175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:00.599065 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:00.601255 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7ed3460a-2fd4-4f5a-95b3-3d84d19680b7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.183496 Sep 02 04:36:00.602231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 569/1126] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:00 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:01.529172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:01.530309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:01.537242 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:01.537890 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:01.538845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:01.539691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:01.621573 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:01.622770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:01.628946 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:01.629607 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:01.630556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:01.631057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:01.637011 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1e2f51d5-0990-42b3-96bd-57b35d178446 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 38303 microversion: 2.1 time: 0.111632 Sep 02 04:36:01.641767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 558/1127] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:36:01 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 38303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 04:36:01.772887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:01.781823 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:01.783549 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:01.784964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eb2b3d6a-a0a9-4ad2-b762-6c0ac63ed9a0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.167746 Sep 02 04:36:01.785990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 570/1128] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:01 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:02.649922 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:02.650855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:02.657196 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.657627 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.658375 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.658795 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.793906 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e7d8f0e9-ac87-4dbf-aed0-fad88135b953 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action" status: 200 len: 38325 microversion: 2.1 time: 0.147871 Sep 02 04:36:02.794541 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 559/1129] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:36:02 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/action => generated 38325 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:36:02.802163 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:02.803320 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:02.804578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:02.805143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:02.809448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.809897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.810781 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.811088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.811939 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.812314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.813077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:02.813511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:02.837665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4283b12c-4287-49c0-a763-bf8aa859a148 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/ips" status: 200 len: 146 microversion: 2.1 time: 0.036984 Sep 02 04:36:02.838599 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 560/1130] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Sep 2 04:36:02 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:36:02.933366 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:02.940995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:02.942494 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:02.943647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a455e916-f4bd-4dc5-8e8b-1e2f61c6a65e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1739 microversion: 2.20 time: 0.145153 Sep 02 04:36:02.944231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 571/1131] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:02 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1739 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:03.961129 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:03.961665 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:03.967898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:03.968369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:03.969124 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:03.969557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:04.091433 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:04.099327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:04.100843 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:04.102579 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9753cde9-e393-47d4-9653-7f055c97dc40 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1721 microversion: 2.20 time: 0.144825 Sep 02 04:36:04.103424 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 561/1132] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:03 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:04.607782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee2660be-5932-4178-9172-4302541a75f8"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:04.613044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:04.615136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:04.615586 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:04.616381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:04.616814 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:05.123732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:05.124474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:05.131609 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:05.132278 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:05.133276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:05.133704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:05.254848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:05.263370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:05.264916 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:05.266058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0d7bd997-6953-4608-9c40-409f563fee5c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1721 microversion: 2.20 time: 0.145998 Sep 02 04:36:05.266610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 562/1133] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:05 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:36:05.485207 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f0ea28ab-d5b8-4512-9d6d-803bf3935805 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882616 Sep 02 04:36:05.485738 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 572/1134] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:36:04 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:06.283709 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:06.284342 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:06.290779 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:06.291224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:06.292019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:06.292448 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:06.412848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:06.420735 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:06.422254 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:06.423496 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-54dee892-ed0f-4f5d-b238-54a113e032a8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1724 microversion: 2.20 time: 0.143401 Sep 02 04:36:06.424070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 563/1135] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:06 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:06.441693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d3ed1c-9a80-4f42-944f-d3f528f0aec2"}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:06.442860 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:06.449243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:06.449678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:06.450422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:06.450844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:07.651317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-b7ce5fe5-e85c-44e7-922b-228916ecbb90 req-822b77a1-1e0f-46ea-ae66-3bdb280eadbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "name": "network-vif-unplugged", "status": "completed", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:07.653675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:36:07.653675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:36:07.660995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b7ce5fe5-e85c-44e7-922b-228916ecbb90 req-822b77a1-1e0f-46ea-ae66-3bdb280eadbc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:07.661430 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b7ce5fe5-e85c-44e7-922b-228916ecbb90 req-822b77a1-1e0f-46ea-ae66-3bdb280eadbc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:07.672451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.compute.server_external_events [req-b7ce5fe5-e85c-44e7-922b-228916ecbb90 req-822b77a1-1e0f-46ea-ae66-3bdb280eadbc service nova] Unable to find a host for instance 0164b812-ed22-4e84-88e6-93e328601f53. Dropping event network-vif-unplugged {{(pid=108891) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 02 04:36:07.673298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-b7ce5fe5-e85c-44e7-922b-228916ecbb90 req-822b77a1-1e0f-46ea-ae66-3bdb280eadbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027938 Sep 02 04:36:07.673860 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 564/1136] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:36:07 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 02 04:36:07.763372 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a8c6c3f1-e4af-48bb-b1ab-df7948c6aff0 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.326194 Sep 02 04:36:07.764038 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 573/1137] 10.222.0.13 () {62 vars in 1364 bytes} [Thu Sep 2 04:36:06 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments => generated 188 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 04:36:07.886093 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:07.886584 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:07.892441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:07.892885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:07.893663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:07.894096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:08.543120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-37092c38-8e22-4f42-bcb0-8387f118696b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments/90d3ed1c-9a80-4f42-944f-d3f528f0aec2" status: 202 len: 0 microversion: 2.20 time: 0.660732 Sep 02 04:36:08.543729 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 565/1138] 10.222.0.13 () {60 vars in 1457 bytes} [Thu Sep 2 04:36:07 2021] DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments/90d3ed1c-9a80-4f42-944f-d3f528f0aec2 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:36:08.600602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:08.601166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:08.607225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:08.607667 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:08.608492 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:08.608919 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:08.816945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d3bc9b11-d1f7-4023-ab32-904b726aa17d tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action" status: 202 len: 0 microversion: 2.20 time: 0.220235 Sep 02 04:36:08.817569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 574/1139] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Sep 2 04:36:08 2021] POST /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:36:08.826001 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:08.826666 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:08.832386 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:08.832821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:08.833597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:08.834018 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:08.953444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:08.961515 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:08.963056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:08.964238 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5504f898-1653-4177-9282-34c3abb4c7c9 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1672 microversion: 2.20 time: 0.141972 Sep 02 04:36:08.964964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 566/1140] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:08 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1672 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:09.982477 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:09.983096 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:09.988938 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:09.989384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:09.990144 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:09.990578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:10.117692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:10.125318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:10.127944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:10.128085 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a0bcd5fd-71c0-4c80-ad62-250e9228b00f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1672 microversion: 2.20 time: 0.149238 Sep 02 04:36:10.128705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 575/1141] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:09 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:11.146545 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:11.147145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:11.153341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:11.153772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:11.154522 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:11.154974 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:11.342134 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:11.350163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:11.351656 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:11.352835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-656581bc-5d84-4baf-b62d-b6d78de30895 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.210014 Sep 02 04:36:11.353388 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 567/1142] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:11 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:12.375343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:12.376889 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:12.383862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:12.384341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:12.385137 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:12.385568 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:12.510247 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:12.518295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:12.520302 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:12.521901 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-47f27605-3323-413a-8e50-3804635af542 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.151219 Sep 02 04:36:12.522675 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 576/1143] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:12 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:13.540977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:13.541622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:13.549776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:13.549776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:13.549776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:13.549776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:13.674788 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:13.682557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:13.684107 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:13.685262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f9ed464e-a0c4-483f-90a6-13d0a4c5b385 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.148727 Sep 02 04:36:13.685819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 568/1144] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:13 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:14.705592 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:14.706290 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:14.713111 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:14.713554 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:14.714321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:14.714752 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:14.843109 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:14.852575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:14.854095 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:14.855252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-23fe9a89-a49b-43f9-aca5-d9392cb421e7 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.154206 Sep 02 04:36:14.855997 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 577/1145] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:14 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 04:36:15.873840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:15.874428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:15.880276 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:15.880718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:15.881474 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:15.881903 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:16.011202 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:16.020176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:16.022170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:16.023324 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4333523c-a3e4-4864-a628-d142f7fa6814 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.153167 Sep 02 04:36:16.023936 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 569/1146] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:15 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:17.041114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:17.041826 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:17.047770 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:17.048240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:17.049004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:17.049431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:17.181348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:17.189148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:17.190618 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:17.191750 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-bd8d333a-e22a-4e56-9bb6-dcec911e14ea tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.154398 Sep 02 04:36:17.192319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 578/1147] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:17 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:18.210773 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:18.212732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:18.224400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:18.225309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:18.226314 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:18.227488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:18.442117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:18.442117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:18.443299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:18.443299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d685cc40-304b-4cd0-826f-11c5c8b45fc6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.180025 Sep 02 04:36:18.443299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 570/1148] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:18 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:19.458212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:19.458815 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:19.464947 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:19.465418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:19.466245 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:19.466671 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:19.724369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:19.724369 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:19.725541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:19.725541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a1b62c4c-77b4-4f71-94ca-a454581473b6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.158341 Sep 02 04:36:19.725541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 579/1149] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:19 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:20.632592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:20.633272 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:20.639517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:20.639990 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:20.640761 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:20.641194 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:20.769879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:20.778006 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:20.779479 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:20.780646 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-552f3e78-24f6-4630-8cc6-fe96e363bf34 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.151896 Sep 02 04:36:20.781201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 571/1150] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:20 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:21.799066 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:21.799681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:21.806105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:21.806662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:21.807420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:21.807929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:21.951420 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:21.953550 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:21.955461 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:21.957689 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e05d869e-21e7-48d3-93f1-d27397e300fa tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.162366 Sep 02 04:36:21.958338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 580/1151] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:21 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:22.976481 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:22.977137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:22.983734 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:22.984219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:22.984982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:22.985417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:23.124050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:23.132344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:23.133858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:23.135069 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9e36fd70-3fb3-4835-be32-3e6725a3ad60 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.162410 Sep 02 04:36:23.135562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 572/1152] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:22 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:24.152933 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:24.153623 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:24.160251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.160697 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:24.161446 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.161871 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:24.281103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:24.288990 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:24.290624 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:24.291866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e70d6e75-bfbd-4a4c-b05f-90c83c0cf66a tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.143338 Sep 02 04:36:24.292648 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 581/1153] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:24 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:24.920687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:24.921704 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:24.927691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.928171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:24.928926 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.929351 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:24.958116 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-55dec77d-97cb-4f87-b9a6-3a9a48d7bfd0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041200 Sep 02 04:36:24.958663 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 573/1154] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:36:24 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:24.968035 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:24.968531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:24.974426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.974913 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:24.975616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:24.976084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:25.004614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-774cb93c-17e3-48e2-ba82-ba51a045bb09 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8" status: 200 len: 194 microversion: 2.1 time: 0.040206 Sep 02 04:36:25.005173 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 582/1155] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Sep 2 04:36:24 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:25.310757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:25.311317 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:25.317077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:25.317519 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:25.318268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:25.318692 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:25.438879 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:25.447187 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:25.448791 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:25.450025 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eb87fadc-3c6a-4a18-bfb2-0588f457ce77 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.143008 Sep 02 04:36:25.450615 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 574/1156] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:25 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:26.468898 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:26.469505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:26.475556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:26.476036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:26.476774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:26.477225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:26.594156 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:26.602009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:26.603497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:26.604665 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e37af5b-a095-496b-a1f1-ba97ba8575c6 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.139639 Sep 02 04:36:26.605213 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 583/1157] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:26 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:26.628677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c216e9b-f6e2-455c-bf33-b7d450e4792c"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:26.629757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:26.635938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:26.636400 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:26.637151 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:26.637574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:27.336386 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-51feff4f-817b-49dc-8362-1beff61f32d2 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711207 Sep 02 04:36:27.337649 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 575/1158] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Sep 2 04:36:26 2021] POST /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:27.622877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:27.623559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:27.629338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:27.629780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:27.630601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:27.631131 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:27.753531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:27.762181 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:27.769439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:27.769439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-597317f5-814f-4fa6-a97d-99d379840249 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.145761 Sep 02 04:36:27.769439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 584/1159] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:27 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:27.777143 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-b9588622-de92-41c8-b4ca-6b4729aa7014 req-11adb988-2ca8-47ef-b7cb-fe2f9206d2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "name": "network-vif-plugged", "status": "completed", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:27.778840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:36:27.778840 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:36:27.786140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b9588622-de92-41c8-b4ca-6b4729aa7014 req-11adb988-2ca8-47ef-b7cb-fe2f9206d2a5 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:27.786580 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-b9588622-de92-41c8-b4ca-6b4729aa7014 req-11adb988-2ca8-47ef-b7cb-fe2f9206d2a5 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:27.797346 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-b9588622-de92-41c8-b4ca-6b4729aa7014 req-11adb988-2ca8-47ef-b7cb-fe2f9206d2a5 service nova] Creating event network-vif-plugged:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:36:27.802172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-b9588622-de92-41c8-b4ca-6b4729aa7014 req-11adb988-2ca8-47ef-b7cb-fe2f9206d2a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029082 Sep 02 04:36:27.802746 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 576/1160] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:36:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:36:28.783002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:28.783666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:28.789841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:28.790292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:28.791070 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:28.791505 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:28.908150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:28.915786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:28.917430 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:28.918590 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2b4b3afe-32c0-4276-9da0-aa186dc18239 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.139416 Sep 02 04:36:28.919152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 585/1161] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:28 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:29.937604 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:29.938329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:29.944265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:29.944712 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:29.945466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:29.945889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:30.069071 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:30.077403 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:30.078900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:30.080099 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-865a7a33-a345-448a-aaaf-fddefdfa12f1 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1730 microversion: 2.20 time: 0.147249 Sep 02 04:36:30.080648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 577/1162] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:29 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:31.098794 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:31.099403 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:31.105208 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:31.105647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:31.106397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:31.106822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:31.222986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:31.230558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:31.232094 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:31.233283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ee242775-9b9a-4cee-baeb-7ccd5084844c tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1717 microversion: 2.20 time: 0.138465 Sep 02 04:36:31.233838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 586/1163] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:36:31 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1717 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:36:35.894096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:35.895005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:35.901123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:35.901567 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:35.902360 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:35.902786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:35.930634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2cd7397c-8a3d-46fb-bfe9-41a34d6bfa4a tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.040239 Sep 02 04:36:35.931173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 578/1164] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:36:35 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 371 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:36.174052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:36.174579 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:36.180394 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:36.180838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:36.181594 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:36.182025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:36.210014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a6029b3e-8d9f-4b1b-93d6-43d57b310e42 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8" status: 200 len: 194 microversion: 2.1 time: 0.039709 Sep 02 04:36:36.210570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 587/1165] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Sep 2 04:36:36 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:36.219605 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:36.220147 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:36.226145 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:36.226587 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:36.227348 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:36.227777 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:36.308262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lazy-loading 'services' on Instance uuid 7c4704c6-71ce-41e9-a0e4-6945d86eac98 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:36:36.509147 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-936d4804-3b48-4c3d-8dbd-ed5c6dd937e8 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8" status: 202 len: 0 microversion: 2.1 time: 0.293052 Sep 02 04:36:36.509807 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 579/1166] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:36:36 2021] DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/ee2660be-5932-4178-9172-4302541a75f8 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:36:38.677565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:38.678056 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:38.684338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:38.684777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:38.685532 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:38.685960 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:38.722542 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-36b739d4-c218-4cd1-b8cb-f01c22852dbe tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/7c216e9b-f6e2-455c-bf33-b7d450e4792c" status: 200 len: 194 microversion: 2.1 time: 0.048445 Sep 02 04:36:38.723569 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 588/1167] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Sep 2 04:36:38 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/7c216e9b-f6e2-455c-bf33-b7d450e4792c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:38.733226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:38.733782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:38.740136 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:38.740574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:38.741693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:38.742117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:38.829501 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lazy-loading 'services' on Instance uuid 7c4704c6-71ce-41e9-a0e4-6945d86eac98 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:36:39.063426 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bfbcce41-8dbf-4de6-8aa9-9f101c72dea0 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/7c216e9b-f6e2-455c-bf33-b7d450e4792c" status: 202 len: 0 microversion: 2.1 time: 0.334119 Sep 02 04:36:39.064036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 580/1168] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Sep 2 04:36:38 2021] DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments/7c216e9b-f6e2-455c-bf33-b7d450e4792c => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:36:40.234308 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:40.235273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:40.241431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.241867 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.242616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.243040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.272174 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ee125043-8d5e-4fb5-803e-ba8d4e316803 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041563 Sep 02 04:36:40.272705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 589/1169] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:36:40 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:36:40.381514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:40.382563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:40.388424 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.389454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.390208 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.390634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.418024 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-407c13bb-ebb3-4494-870a-3cc7b97e2e49 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041171 Sep 02 04:36:40.418560 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 581/1170] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Sep 2 04:36:40 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 04:36:40.489939 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:40.490427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:40.496314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.496761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.497506 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.498008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.521647 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:36:40.858234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7222e100-f391-467e-b7cd-f834d9f44cbd tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 204 len: 0 microversion: 2.1 time: 0.371614 Sep 02 04:36:40.858811 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 590/1171] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:36:40 2021] DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:36:40.866919 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:40.867524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:40.873904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.874339 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.875077 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:40.875499 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:40.994321 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:41.001957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-811d76fb-cac2-4995-97cd-3300eae6e631 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1674 microversion: 2.1 time: 0.138782 Sep 02 04:36:41.002520 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 582/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:40 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1674 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:36:42.019211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:42.019921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:42.025735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:42.026172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:42.026918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:42.027343 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:42.147384 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:42.154535 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4b81007a-9290-4216-aa50-97a902028411 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1674 microversion: 2.1 time: 0.139360 Sep 02 04:36:42.155076 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 591/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:42 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1674 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:36:43.170304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:43.170821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:43.177523 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:43.177969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:43.178727 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:43.179157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:43.350454 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:43.357636 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-93aa477c-6738-47eb-b8bc-dae2e49f4668 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1674 microversion: 2.1 time: 0.191044 Sep 02 04:36:43.358199 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 583/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:43 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:36:44.027955 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-16756462-1b9d-4fe9-bdc6-06cd9c95dcf4 req-2beb46bd-19a1-4d2e-bdba-6b369a203427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4704c6-71ce-41e9-a0e4-6945d86eac98", "name": "network-vif-deleted", "tag": "30234d74-b9ed-48a4-ac77-9d01af5c2a78"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:36:44.029653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:36:44.029653 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:36:44.036348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-16756462-1b9d-4fe9-bdc6-06cd9c95dcf4 req-2beb46bd-19a1-4d2e-bdba-6b369a203427 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:44.036786 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-16756462-1b9d-4fe9-bdc6-06cd9c95dcf4 req-2beb46bd-19a1-4d2e-bdba-6b369a203427 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:44.047501 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-16756462-1b9d-4fe9-bdc6-06cd9c95dcf4 req-2beb46bd-19a1-4d2e-bdba-6b369a203427 service nova] Creating event network-vif-deleted:30234d74-b9ed-48a4-ac77-9d01af5c2a78 for instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 on hv-cinder-80473 Sep 02 04:36:44.052776 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-16756462-1b9d-4fe9-bdc6-06cd9c95dcf4 req-2beb46bd-19a1-4d2e-bdba-6b369a203427 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028299 Sep 02 04:36:44.053353 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 592/1175] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:36:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:36:44.375129 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:44.375785 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:44.381617 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:44.384518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:44.384518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:44.384518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:44.412782 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:44.413224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:44.413668 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lazy-loading 'fault' on Instance uuid 7c4704c6-71ce-41e9-a0e4-6945d86eac98 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:36:44.453207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b791f5771da4415b056655a1b3aed49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c30d815e4b455b8ab704d7e86dbf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:36:44.460571 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f68cb8fc-42cd-40e3-9190-825720f8f211 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 200 len: 1328 microversion: 2.1 time: 0.089850 Sep 02 04:36:44.461344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 584/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:44 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:36:45.478259 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:45.478945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:45.484830 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:45.485269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:45.486012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:45.486438 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:45.499735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. Sep 02 04:36:45.500342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:36:45.501133 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-00e2a943-52d5-4470-a7af-1ee2435dc7b7 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 404 len: 111 microversion: 2.1 time: 0.026902 Sep 02 04:36:45.501635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 593/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:45 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:36:45.509717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cf3d791b-2975-4a91-b058-61df760a2d84 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '.version_select at 0x7fa04b18d8b0>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:45.647524 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cf3d791b-2975-4a91-b058-61df760a2d84 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822432974" status: 202 len: 0 microversion: 2.1 time: 0.141364 Sep 02 04:36:45.648035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 585/1178] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Sep 2 04:36:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822432974 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 04:36:48.939464 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:48.939988 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:48.945627 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:48.946071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:48.946827 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:48.947253 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:48.960551 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. Sep 02 04:36:48.961125 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:36:48.961921 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5bca0951-2e15-4867-b73c-8d5f9a16be44 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 404 len: 111 microversion: 2.1 time: 0.026185 Sep 02 04:36:48.962436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:36:48 2021] DELETE /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:36:48.971036 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:48.971900 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: 7c4704c6-71ce-41e9-a0e4-6945d86eac98] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:48.977561 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:48.978009 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:48.978763 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:48.979192 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:48.992056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. Sep 02 04:36:48.992629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance 7c4704c6-71ce-41e9-a0e4-6945d86eac98 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:36:48.993458 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-23449072-61af-4752-aa91-ff1dc4d7c9f5 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98" status: 404 len: 111 microversion: 2.1 time: 0.027252 Sep 02 04:36:48.993966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 586/1180] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:48 2021] GET /compute/v2.1/servers/7c4704c6-71ce-41e9-a0e4-6945d86eac98 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 04:36:50.329585 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:50.330076 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:50.335775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:50.336256 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:50.337008 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:50.337433 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:50.350993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. Sep 02 04:36:50.351591 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:36:50.352416 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1fb4c97f-9e0e-4deb-af95-c9b0c569d7c4 tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 404 len: 111 microversion: 2.1 time: 0.027022 Sep 02 04:36:50.352916 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 595/1181] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:36:50 2021] DELETE /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:36:50.360329 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:36:50.360973 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] [instance: a1fdfd22-1160-4f16-ad90-ec2fd5150229] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:36:50.366724 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:50.367173 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:50.367946 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:36:50.368382 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:36:50.381228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] HTTP exception thrown: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. Sep 02 04:36:50.381825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] Returning 404 to user: Instance a1fdfd22-1160-4f16-ad90-ec2fd5150229 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:36:50.382629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9b46aad8-3d83-445c-8178-28e84b95ad9e tempest-AttachVolumeTestJSON-257697887 tempest-AttachVolumeTestJSON-257697887-project] 10.222.0.13 "GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229" status: 404 len: 111 microversion: 2.1 time: 0.025959 Sep 02 04:36:50.383140 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 587/1182] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:36:50 2021] GET /compute/v2.1/servers/a1fdfd22-1160-4f16-ad90-ec2fd5150229 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:37:02.655040 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:02.656039 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:02.662011 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:02.662455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:02.663199 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:02.663625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:02.690986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6a85f116-355b-4ab2-8b89-de6dadd1f06e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.039798 Sep 02 04:37:02.691524 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 596/1183] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Sep 2 04:37:02 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:37:02.749818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:02.750341 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:02.756441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:02.756881 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:02.757634 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:02.758058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:02.782030 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:37:03.068893 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-91f6c633-f846-4e66-8f44-08cff8b4b07b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 204 len: 0 microversion: 2.20 time: 0.322882 Sep 02 04:37:03.069471 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 588/1184] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Sep 2 04:37:02 2021] DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 04:37:03.077732 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:03.078338 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:03.084135 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:03.084575 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:03.085323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:03.085750 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:03.205511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:03.213321 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:03.214849 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:03.216028 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-41ae6707-2fc8-4717-8d20-fc155b8cdade tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.142094 Sep 02 04:37:03.216580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 597/1185] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:03 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:04.235739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:04.236463 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:04.242137 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:04.242578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:04.243338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:04.243765 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:04.361981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:04.369674 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:04.371169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:04.372401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-987b90fd-b9c3-4e31-864e-d6f75db12a2b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1723 microversion: 2.20 time: 0.141486 Sep 02 04:37:04.372954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 589/1186] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:04 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:05.389787 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:05.390349 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:05.396467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:05.396942 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:05.397818 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:05.398276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:05.468347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:05.476764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:05.478235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:05.479413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a8d25df1-5bba-4d2f-9aef-e0ae98bd5638 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1656 microversion: 2.20 time: 0.093719 Sep 02 04:37:05.480323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 598/1187] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:05 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:05.506089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-874286d0-5c47-4376-9b49-ceef8da97126 req-438136cb-7744-41a6-8593-75c2a693727a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0164b812-ed22-4e84-88e6-93e328601f53", "name": "network-vif-deleted", "tag": "0d20e93c-b79a-4ab1-8a5b-9b2eb4567477"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:37:05.507591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:37:05.507591 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:37:05.515101 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-874286d0-5c47-4376-9b49-ceef8da97126 req-438136cb-7744-41a6-8593-75c2a693727a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:05.515530 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-874286d0-5c47-4376-9b49-ceef8da97126 req-438136cb-7744-41a6-8593-75c2a693727a service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:05.527086 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-874286d0-5c47-4376-9b49-ceef8da97126 req-438136cb-7744-41a6-8593-75c2a693727a service nova] Creating event network-vif-deleted:0d20e93c-b79a-4ab1-8a5b-9b2eb4567477 for instance 0164b812-ed22-4e84-88e6-93e328601f53 on hv-cinder-80473 Sep 02 04:37:05.532216 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-874286d0-5c47-4376-9b49-ceef8da97126 req-438136cb-7744-41a6-8593-75c2a693727a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 Sep 02 04:37:05.532811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 590/1188] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:37:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:37:06.497889 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:06.498428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:06.504692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:06.508303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:06.508303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:06.508303 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:06.566423 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:06.573969 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:06.575458 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:06.576597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-beb6d6f2-e6f9-4dee-bc0b-453125dc9b7e tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1366 microversion: 2.20 time: 0.082611 Sep 02 04:37:06.577767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 599/1189] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:06 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:07.595357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:07.596335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:07.602302 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:07.602740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:07.603514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:07.603960 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:07.634234 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:07.634664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:07.635097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'fault' on Instance uuid 0164b812-ed22-4e84-88e6-93e328601f53 {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:37:07.672405 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:07.679664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:07.681176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:07.682298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-3e7dab38-836a-4901-a67e-125eb0c83ce8 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1371 microversion: 2.20 time: 0.091068 Sep 02 04:37:07.682845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 591/1190] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:07 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:08.700469 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:08.701076 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:08.707482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:08.707924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:08.708677 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:08.709098 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:08.738541 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:08.738979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:08.739436 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lazy-loading 'fault' on Instance uuid 0164b812-ed22-4e84-88e6-93e328601f53 {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:37:08.779556 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:08.787695 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:08.789235 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43c1c2ebcbbc4abfa39cb2ce4d29f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0931655f059d4af598f60bd195366b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:08.790422 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7ee7750c-74d9-489b-b65e-60eea0c9f042 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 200 len: 1371 microversion: 2.20 time: 0.093621 Sep 02 04:37:08.790973 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 600/1191] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:08 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 04:37:09.808336 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:09.808956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:09.815421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:09.815858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:09.816642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:09.817070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:09.829726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. Sep 02 04:37:09.830294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:37:09.831252 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-680238e9-14eb-4063-a29c-6d4cca6a449f tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 404 len: 111 microversion: 2.20 time: 0.026695 Sep 02 04:37:09.831772 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 592/1192] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Sep 2 04:37:09 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 04:37:09.839747 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-11934d00-965f-4453-97c1-b99f93be9679 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '.version_select at 0x7fa04b313dc0>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:09.958323 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-11934d00-965f-4453-97c1-b99f93be9679 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-308117454" status: 204 len: 0 microversion: 2.20 time: 0.122099 Sep 02 04:37:09.958897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 601/1193] 10.222.0.13 () {60 vars in 1259 bytes} [Thu Sep 2 04:37:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-308117454 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 04:37:12.059585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:12.060117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:12.065739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:12.066175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:12.066935 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:12.067355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:12.080677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. Sep 02 04:37:12.081239 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:37:12.082056 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ee0d46bd-e780-4448-b2cb-7d8bf2bbb175 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 404 len: 111 microversion: 2.1 time: 0.026113 Sep 02 04:37:12.082563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 593/1194] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:37:12 2021] DELETE /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:37:12.090219 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:12.090834 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 0164b812-ed22-4e84-88e6-93e328601f53] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:12.097419 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:12.097865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:12.098618 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:12.099048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:12.111879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. Sep 02 04:37:12.112475 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 0164b812-ed22-4e84-88e6-93e328601f53 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:37:12.113275 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-33655902-107b-4b2d-ac78-463324ecf8d5 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53" status: 404 len: 111 microversion: 2.1 time: 0.026770 Sep 02 04:37:12.113865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 602/1195] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:12 2021] GET /compute/v2.1/servers/0164b812-ed22-4e84-88e6-93e328601f53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:37:13.472098 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:13.472574 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:13.478170 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:13.478611 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:13.479355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:13.479781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:13.493250 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. Sep 02 04:37:13.493824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:37:13.494629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-187964d3-3a9d-44b6-9f23-f9497a2ac12b tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 404 len: 111 microversion: 2.1 time: 0.026452 Sep 02 04:37:13.495205 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 594/1196] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:37:13 2021] DELETE /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:37:13.509094 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:13.509706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] [instance: 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:13.516789 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:13.517233 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:13.518037 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:13.518467 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:13.531444 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] HTTP exception thrown: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. Sep 02 04:37:13.532082 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] Returning 404 to user: Instance 4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:37:13.532899 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-75587304-9655-42a2-8bfb-9a19e0d8e268 tempest-AttachVolumeShelveTestJSON-316804975 tempest-AttachVolumeShelveTestJSON-316804975-project] 10.222.0.13 "GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9" status: 404 len: 111 microversion: 2.1 time: 0.032962 Sep 02 04:37:13.535699 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 603/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:13 2021] GET /compute/v2.1/servers/4cfd99e1-6290-4fb0-bd40-67ddb80ca3d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:37:52.963556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:37:52.964175 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:52.970550 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:52.970996 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:52.971752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:52.972217 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:52.993816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.objects.instance [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lazy-loading 'flavor' on Instance uuid ed453ad1-7f33-41ce-9845-743b020e883c {{(pid=108891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:37:53.383706 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-60d6ddc6-9e42-4b57-8c18-bd6e07bc7ea4 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "POST /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c/action" status: 202 len: 0 microversion: 2.1 time: 0.423680 Sep 02 04:37:53.384350 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 595/1198] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:37:52 2021] POST /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:37:53.392614 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:53.393382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:53.399396 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:53.399846 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:53.400832 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:53.401425 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:53.529987 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:53.538334 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-62769452-8ea8-4d1d-a1b0-8cea96155eb2 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.149580 Sep 02 04:37:53.538893 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 604/1199] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:53 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:37:54.555873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:54.556603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:54.562437 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:54.562878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:54.563638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:54.564090 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:54.686050 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:54.694085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-af360cd0-8977-468b-93de-1704ce845aed tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.142292 Sep 02 04:37:54.694642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 596/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:54 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:37:55.710950 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:55.711819 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:55.719929 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:55.720886 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:55.721798 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:55.722247 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:55.869314 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:55.878496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e6c2f1e0-c007-456e-9d3a-653beb75e055 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.171844 Sep 02 04:37:55.879666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 605/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:55 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:37:56.896506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:56.897034 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:56.902983 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:56.903428 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:56.904222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:56.904693 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:57.025359 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:57.032696 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ade70f04-2536-474d-b94b-46dad1f816b1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.140493 Sep 02 04:37:57.033253 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 597/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:56 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:37:58.049452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:58.050068 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:58.056419 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:58.056865 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:58.057631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:58.058071 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:58.175630 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:58.183775 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eebe6d21-cc1b-4f7f-9b07-0485de2228dc tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.137918 Sep 02 04:37:58.184374 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 606/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:58 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:37:59.200472 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:37:59.201163 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:37:59.206930 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:59.207370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:59.208176 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:37:59.208622 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:37:59.324291 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:37:59.331752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-477b9842-8ab1-4b25-bf36-d63bc8e15e65 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.134944 Sep 02 04:37:59.332344 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 598/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:37:59 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:00.348580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:00.349210 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:00.355052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:00.355491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:00.356261 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:00.356683 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:00.476707 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:00.490684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a61f4753-6bb4-433a-9381-72f5f344c00b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.139373 Sep 02 04:38:00.490684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 607/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:00 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:01.505058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:01.506307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:01.512085 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:01.512529 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:01.513277 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:01.513719 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:01.628825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:01.636197 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1b205bfb-fe98-4390-851c-0aa907c53766 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.134780 Sep 02 04:38:01.636767 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 599/1206] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:01 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:02.653044 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:02.653562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:02.659373 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:02.659814 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:02.660582 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:02.661007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:02.778126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:02.785479 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fdc10593-b19c-40a6-a396-cf81c0acde11 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.136192 Sep 02 04:38:02.786031 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 608/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:02 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:03.801923 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:03.802581 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:03.810436 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:03.811015 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:03.811720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:03.812171 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:03.945123 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:03.953798 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-2069c91c-b269-4090-b976-70963fa3eef6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.155715 Sep 02 04:38:03.954367 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 600/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:03 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:04.972053 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:04.973287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:04.981442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:04.981442 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:04.983455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:04.983897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:05.104551 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:05.112139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-94137ed5-c3d7-4fe3-8131-52a48735c3e6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.144166 Sep 02 04:38:05.112721 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 609/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:04 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:06.129672 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:06.130303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:06.136638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:06.141224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:06.141224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:06.141224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:06.162246 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:38:06.166993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:38:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c (ip 10.222.0.13) !!! Sep 02 04:38:06.259701 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:06.267035 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-50714339-c9a0-4366-95cc-d4ecc9971886 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.141024 Sep 02 04:38:06.267618 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 601/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:06 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:07.284154 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:07.284858 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:07.290555 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:07.291002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:07.291759 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:07.292214 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:07.415666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:07.422843 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-d1f57a5e-70e2-4870-853c-e68b318a6f93 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.142369 Sep 02 04:38:07.423401 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 610/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:07 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:08.439421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:08.440068 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:08.446383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:08.446817 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:08.447613 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:08.448065 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:08.564899 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:08.572732 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0113e1ae-d3c7-4559-9770-189d30e6018a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.137174 Sep 02 04:38:08.573743 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 602/1212] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:08 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:09.589064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:09.589678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:09.595633 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:09.596123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:09.598998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:09.598998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:09.712981 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:09.720499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f5cb80fa-bfad-4376-88f3-bfe9eff04d79 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.136018 Sep 02 04:38:09.721063 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 611/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:09 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:10.737818 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:10.738434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:10.744614 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:10.745052 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:10.745801 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:10.746229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:10.874260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:10.882113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-339df662-1575-47d7-81e5-afb9b0f12996 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.147920 Sep 02 04:38:10.883484 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 603/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:10 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:11.899145 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:11.899761 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:11.905511 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:11.905954 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:11.906705 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:11.907139 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:12.026613 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:12.033880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-22cde575-aa0f-4bf8-a0bd-21ee360f4d23 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.139137 Sep 02 04:38:12.034447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 612/1215] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:11 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:13.050182 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:13.050964 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:13.056793 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.057233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.057976 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.058398 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.182457 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:13.189847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-aca08a8f-4350-417b-b099-3b25615e15fa tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1512 microversion: 2.1 time: 0.143299 Sep 02 04:38:13.190408 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 604/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:13 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:13.206094 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:38:13.206660 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:13.213273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.219576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.219576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.219576 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.446844 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-7632c8b7-945c-4883-9c12-99fcfd0d0b8c tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "POST /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c/action" status: 202 len: 0 microversion: 2.1 time: 0.244415 Sep 02 04:38:13.447548 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 613/1217] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Sep 2 04:38:13 2021] POST /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:38:13.461144 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:13.462225 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:13.468809 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.469861 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.470741 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:13.471229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:13.622514 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:13.630397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-07368b02-d5de-4524-83ad-ddf8a6352f14 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1520 microversion: 2.1 time: 0.175772 Sep 02 04:38:13.631292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 605/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:13 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:14.647147 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:14.647767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:14.654142 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:14.654580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:14.655340 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:14.655767 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:14.772534 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:14.779734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dfeb84a9-453e-4824-b850-31ec343fd4a0 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1520 microversion: 2.1 time: 0.137173 Sep 02 04:38:14.780329 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 614/1219] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:14 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1520 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:38:15.797401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:15.798014 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:15.803800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:15.804338 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:15.805072 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:15.805500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:15.936150 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:15.940210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-92c8b819-1f14-4e0c-9911-016adfe0651d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1520 microversion: 2.1 time: 0.146999 Sep 02 04:38:15.940776 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 606/1220] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:15 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:16.386273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-a810d58b-1d66-4b4c-9413-52c5a26b6bc1 req-0e8d5b35-fc8c-4851-bca3-1f3c391d5911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "name": "network-vif-unplugged", "status": "completed", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:38:16.387887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:38:16.387887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:38:16.395526 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a810d58b-1d66-4b4c-9413-52c5a26b6bc1 req-0e8d5b35-fc8c-4851-bca3-1f3c391d5911 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:16.396002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-a810d58b-1d66-4b4c-9413-52c5a26b6bc1 req-0e8d5b35-fc8c-4851-bca3-1f3c391d5911 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:16.407300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.compute.server_external_events [req-a810d58b-1d66-4b4c-9413-52c5a26b6bc1 req-0e8d5b35-fc8c-4851-bca3-1f3c391d5911 service nova] Unable to find a host for instance ed453ad1-7f33-41ce-9845-743b020e883c. Dropping event network-vif-unplugged {{(pid=108890) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 02 04:38:16.408211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-a810d58b-1d66-4b4c-9413-52c5a26b6bc1 req-0e8d5b35-fc8c-4851-bca3-1f3c391d5911 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025785 Sep 02 04:38:16.408798 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 615/1221] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:38:16 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 02 04:38:16.957504 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:16.958043 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:16.963957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:16.964401 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:16.966954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:16.966954 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:17.081675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:17.088843 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-5bcd82cc-fe44-4409-9e82-dbbcd1de4d1f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1522 microversion: 2.1 time: 0.135252 Sep 02 04:38:17.089399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 607/1222] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:16 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:18.105959 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:18.106578 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:18.112300 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:18.112746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:18.113496 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:18.113923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:18.235491 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:18.243115 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6d181b1d-4fad-4452-b796-0a60d5a63cd6 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1522 microversion: 2.1 time: 0.140874 Sep 02 04:38:18.246287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 616/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:18 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:19.260383 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:19.260998 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:19.266811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:19.267357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:19.268307 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:19.268821 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:19.410418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:19.418500 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-31ba866d-ac20-46c2-9509-6ae18599bc3f tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.161905 Sep 02 04:38:19.419096 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 608/1224] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:19 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:20.435258 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:20.435998 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:20.441528 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:20.442175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:20.443101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:20.443693 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:20.563878 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:20.571720 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f46137d2-f941-4564-bf45-fde86a7e41ee tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.140045 Sep 02 04:38:20.572914 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 617/1225] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:20 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:21.589495 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:21.590000 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:21.598070 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:21.598517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:21.599299 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:21.599731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:21.730835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:21.733305 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f28e12bf-2c66-4b73-98d3-9553aa5b7d53 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.148307 Sep 02 04:38:21.734117 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 609/1226] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:21 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:22.750862 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:22.751560 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:22.757335 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:22.757910 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:22.758663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:22.759093 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:22.879758 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:22.887283 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6b243b74-7d6d-4bae-9878-3d9e49b8292a tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.140094 Sep 02 04:38:22.887928 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 618/1227] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:22 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:23.904206 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:23.904839 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:23.910468 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:23.910957 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:23.911691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:23.912210 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:24.051421 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:24.059643 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-cb2f00f2-916c-414a-8e05-f5439260ba69 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.159069 Sep 02 04:38:24.060555 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 610/1228] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:23 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:25.076790 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:25.077413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:25.079873 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 04:38:25.084368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:25.084847 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:25.085609 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:25.086118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:25.209211 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:25.217194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ecfc8c02-1d7b-47a3-a0d9-651ebcc0450e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.144567 Sep 02 04:38:25.218007 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 619/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:25 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:26.236953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:26.237662 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:26.244224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:26.244799 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:26.245588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:26.246059 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:26.375017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:26.384738 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ff229bc1-ab32-46e4-ad3b-50c859cf43fe tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.152861 Sep 02 04:38:26.385309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 611/1230] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:26 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:27.403596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:27.404516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:27.424802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:27.428678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:27.428678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:27.428678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:27.430455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 47706. Sep 02 04:38:27.547774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:27.555036 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-3a234365-41f1-4479-894f-55a126259a75 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.156961 Sep 02 04:38:27.555596 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 620/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:27 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:28.571858 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:28.572564 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:28.578368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:28.581319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:28.581319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:28.581319 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:28.707206 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:28.714756 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-bfef43f2-1d82-4a2c-9bf6-7c8b79ba9f1e tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.146568 Sep 02 04:38:28.715333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 612/1232] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:28 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:29.732277 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:29.732914 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:29.738639 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:29.739087 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:29.739848 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:29.740305 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:29.856616 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:29.863820 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e96e87d6-feba-4df6-a64c-dc707e4b2147 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.135959 Sep 02 04:38:29.864734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 621/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:29 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:30.740650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-6e0a4e1c-594d-43de-84c7-f8a847b6c73b req-647550e6-629c-46e1-a371-27d7bdc6962f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "name": "network-vif-plugged", "status": "completed", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:38:30.742533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:38:30.742533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:38:30.750333 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6e0a4e1c-594d-43de-84c7-f8a847b6c73b req-647550e6-629c-46e1-a371-27d7bdc6962f service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:30.750775 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-6e0a4e1c-594d-43de-84c7-f8a847b6c73b req-647550e6-629c-46e1-a371-27d7bdc6962f service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:30.762266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-6e0a4e1c-594d-43de-84c7-f8a847b6c73b req-647550e6-629c-46e1-a371-27d7bdc6962f service nova] Creating event network-vif-plugged:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:38:30.768447 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-6e0a4e1c-594d-43de-84c7-f8a847b6c73b req-647550e6-629c-46e1-a371-27d7bdc6962f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Sep 02 04:38:30.769557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 613/1234] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:38:30.881160 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:30.881795 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:30.893562 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:30.894017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:30.894831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:30.895266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:31.190223 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:31.197923 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-1f9f8194-c71e-4f2f-add5-aa83136d9948 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.321211 Sep 02 04:38:31.198500 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 622/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:30 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:32.215390 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:32.216236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:32.222874 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:32.223394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:32.224115 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:32.224543 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:32.817740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:32.826781 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-dd3785fb-36c8-45cd-9078-6dfc553a9c32 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1578 microversion: 2.1 time: 0.615951 Sep 02 04:38:32.827466 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 614/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:32 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1578 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:38:33.846287 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:38:33.847552 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:38:33.859119 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:33.859635 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:33.860880 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:38:33.862931 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:38:34.077114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:38:34.086602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-133d0a32-67a5-419c-a236-c1cedd13f55b tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1565 microversion: 2.1 time: 0.246154 Sep 02 04:38:34.115675 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 623/1237] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:38:33 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1565 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:38:41.241229 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Action: 'create', calling method: .version_select at 0x7fa04b1feca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1210854978"}} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:38:41.259161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for project 806b9f6ba89a498d91b52d657b7af897. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:38:41.263791 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for user 5ebd9ebcc51348b0bc75c8cfa90e2db1 and project 806b9f6ba89a498d91b52d657b7af897. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:38:41.563603 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for project 806b9f6ba89a498d91b52d657b7af897. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:38:41.570871 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.quota [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for user 5ebd9ebcc51348b0bc75c8cfa90e2db1 and project 806b9f6ba89a498d91b52d657b7af897. Resources: {'key_pairs'} {{(pid=108891) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:38:41.584953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eac10f66-46e4-45f0-a450-c95d9851616c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.523275 Sep 02 04:38:41.585555 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 615/1238] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Sep 2 04:38:41 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:03.185531 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-889516033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210854978", "security_groups": [{"name": "tempest-secgroup-smoke-1572465320"}], "block_device_mapping_v2": [{"uuid": "35ebefaf-fb49-4d0e-80a4-194f5b74a0ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94925f62-31db-412f-a5ea-04108ada5944"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:03.286742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] validate_networks() for [('94925f62-31db-412f-a5ea-04108ada5944', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:39:03.639778 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:39:03.640797 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:39:03.641266 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:39:03.641672 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:39:03.642079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:39:03.650539 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:03.651109 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:03.651757 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:03.652263 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:03.670559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:39:03.674452 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for user 5ebd9ebcc51348b0bc75c8cfa90e2db1 and project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:39:03.733909 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:39:03.740658 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35ebefaf-fb49-4d0e-80a4-194f5b74a0ee',volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:39:04.243637 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-19094fe2-5e8e-46ad-8317-7d54527e04ec tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.061726 Sep 02 04:39:04.247380 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 624/1239] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:39:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 04:39:04.256726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-c3c97d33-cf54-4573-a2be-a7cf5a8f26a3 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:04.259311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-c3c97d33-cf54-4573-a2be-a7cf5a8f26a3 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:04.318473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-c3c97d33-cf54-4573-a2be-a7cf5a8f26a3 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:04.358372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-c3c97d33-cf54-4573-a2be-a7cf5a8f26a3 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1094 microversion: 2.1 time: 0.075155 Sep 02 04:39:04.358372 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 616/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:04 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:05.342471 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:05.343099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:05.349276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:05.349728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:05.350490 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:05.350918 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:05.409760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:05.417517 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-67668214-5f2b-46a3-a69d-d0f9f6e52462 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1144 microversion: 2.1 time: 0.078796 Sep 02 04:39:05.418083 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 625/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:05 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:06.441122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:06.441742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:06.448271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:06.448716 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:06.452049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:06.452049 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:06.513037 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:06.521265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1ef39264-272b-45e0-9b56-3289f29af588 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1200 microversion: 2.1 time: 0.084148 Sep 02 04:39:06.521838 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 617/1242] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:06 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:07.540360 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:07.541149 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:07.546884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:07.547664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:07.548666 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:07.549273 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:07.692168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:07.699701 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-2882e3b2-b9b5-431e-95f9-155baf0fec2f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1278 microversion: 2.1 time: 0.162959 Sep 02 04:39:07.700418 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 626/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:07 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:08.254488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-a31da758-9cd4-41a3-91ff-a3a4a747ca2b req-7e1986bc-ad69-4c56-a6ae-d0096d7af5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3415c-a3fb-4a04-b739-9e7da03cb425", "tag": "4deda306-bddf-422e-9b02-41b37d716a44"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:08.255955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:39:08.255955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:39:08.264790 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-a31da758-9cd4-41a3-91ff-a3a4a747ca2b req-7e1986bc-ad69-4c56-a6ae-d0096d7af5bd service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:08.267181 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-a31da758-9cd4-41a3-91ff-a3a4a747ca2b req-7e1986bc-ad69-4c56-a6ae-d0096d7af5bd service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:08.293149 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-a31da758-9cd4-41a3-91ff-a3a4a747ca2b req-7e1986bc-ad69-4c56-a6ae-d0096d7af5bd service nova] Creating event network-changed:4deda306-bddf-422e-9b02-41b37d716a44 for instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 on hv-cinder-80473 Sep 02 04:39:08.305041 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-a31da758-9cd4-41a3-91ff-a3a4a747ca2b req-7e1986bc-ad69-4c56-a6ae-d0096d7af5bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054492 Sep 02 04:39:08.308399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 618/1244] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:39:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:39:08.717262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:08.717866 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:08.723742 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:08.724212 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:08.724964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:08.725390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:08.845502 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:08.853572 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-edc29360-6708-4baa-a583-dd413ba0431c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.139968 Sep 02 04:39:08.854352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 627/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:08 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:09.870578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:09.871268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:09.877235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:09.878157 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:09.878903 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:09.879325 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:09.998348 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:10.006557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-075c80ae-b0a7-44a2-933c-6e0230f1d12a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.139873 Sep 02 04:39:10.007127 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 619/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:09 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:11.024135 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:11.024746 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:11.030604 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:11.031052 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:11.031805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:11.032263 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:11.150986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:11.158166 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-fdbc2d93-5a20-47eb-8fca-bfc52edd0bbb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.137734 Sep 02 04:39:11.159234 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 628/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:11 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:12.174606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:12.175162 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:12.181853 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:12.182298 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:12.183395 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:12.183883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:12.305263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:12.312417 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e51db718-e58c-4ee6-ba6a-dd21357186ff tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.141685 Sep 02 04:39:12.312977 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 620/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:12 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:13.328914 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:13.329519 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:13.336063 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:13.336508 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:13.337291 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:13.337719 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:13.460265 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:13.467410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b862a0a2-f9f6-4e7d-bdbe-12cf205723fe tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.142252 Sep 02 04:39:13.467994 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 629/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:13 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:14.483716 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:14.487174 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:14.490929 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:14.491376 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:14.492370 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:14.492889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:14.612786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:14.620224 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-434d28fd-2e9a-4541-8b04-b9f82f631307 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.140227 Sep 02 04:39:14.620982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 621/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:14 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:15.637148 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:15.637678 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:15.643641 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:15.644118 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:15.644861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:15.645285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:15.763439 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:15.771025 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-76bc2b47-67df-43af-9165-102a8c30bce6 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.137630 Sep 02 04:39:15.771615 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 630/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:15 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:16.786482 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:16.787100 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:16.792795 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:16.793241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:16.793994 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:16.794446 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:16.913007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:16.920159 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b37b418e-207c-4769-a9f1-fd6b2702d463 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.137285 Sep 02 04:39:16.920718 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 622/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:16 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:17.937561 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:17.938169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:17.944499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:17.944943 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:17.945680 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:17.946104 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:18.063841 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:18.072246 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-70541caf-5761-4c81-a7b9-6b00951af811 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.138198 Sep 02 04:39:18.072874 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 631/1253] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:17 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:18.996700 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-9db4c708-06a5-4e46-a1e9-e3fed01da34f req-b6d8a276-0fd9-4d38-8775-a142a9ace229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3415c-a3fb-4a04-b739-9e7da03cb425", "name": "network-vif-plugged", "status": "completed", "tag": "4deda306-bddf-422e-9b02-41b37d716a44"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:18.998328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:39:18.998328 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:39:19.005148 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9db4c708-06a5-4e46-a1e9-e3fed01da34f req-b6d8a276-0fd9-4d38-8775-a142a9ace229 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:19.005578 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9db4c708-06a5-4e46-a1e9-e3fed01da34f req-b6d8a276-0fd9-4d38-8775-a142a9ace229 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:19.016263 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-9db4c708-06a5-4e46-a1e9-e3fed01da34f req-b6d8a276-0fd9-4d38-8775-a142a9ace229 service nova] Creating event network-vif-plugged:4deda306-bddf-422e-9b02-41b37d716a44 for instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 on hv-cinder-80473 Sep 02 04:39:19.022154 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-9db4c708-06a5-4e46-a1e9-e3fed01da34f req-b6d8a276-0fd9-4d38-8775-a142a9ace229 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028880 Sep 02 04:39:19.023122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 623/1254] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:39:19.090269 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:19.090884 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:19.097011 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:19.097453 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:19.099012 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:19.099597 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:19.229777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:19.239900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-87ca9691-74b0-4ccf-8c1d-64a0a2e3561c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.153252 Sep 02 04:39:19.240526 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 632/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:19 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:20.257677 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:20.258396 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:20.264691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:20.265131 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:20.265878 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:20.266304 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:20.384121 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:20.391294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-fe9991e9-b37e-4587-b9ee-69b492fcd5ef tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1266 microversion: 2.1 time: 0.137642 Sep 02 04:39:20.391866 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 624/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:20 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:21.408380 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:21.408986 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:21.414699 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:21.415141 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:21.415876 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:21.416318 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:21.532671 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:21.540691 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a16030d0-b954-415d-b1d5-d532e874cfed tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1453 microversion: 2.1 time: 0.136070 Sep 02 04:39:21.541252 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 633/1257] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:21 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:21.556273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:21.556819 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:21.562540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:21.562979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:21.563788 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:21.564240 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:21.678771 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:21.685914 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-73b0a6bc-2c84-4c6d-8a38-6bd4e4aca9fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1453 microversion: 2.1 time: 0.133311 Sep 02 04:39:21.686473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 625/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:21 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:23.963527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3415c-a3fb-4a04-b739-9e7da03cb425", "tag": "4deda306-bddf-422e-9b02-41b37d716a44"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:23.965015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:39:23.965015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:39:23.972694 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:23.973132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:23.984371 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] Creating event network-changed:4deda306-bddf-422e-9b02-41b37d716a44 for instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 on hv-cinder-80473 Sep 02 04:39:23.987831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: ERROR oslo.messaging._drivers.impl_rabbit [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] [b46d5658-aedb-43bd-b02a-06fe5b838f92] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 04:39:25.004279 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] [b46d5658-aedb-43bd-b02a-06fe5b838f92] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48498. Sep 02 04:39:25.007429 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-468fa41d-cec1-4d50-814f-9f3807664c9c req-a8aa143d-c8f0-475a-890a-93b17a596967 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047682 Sep 02 04:39:25.008195 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 634/1259] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:39:48.707658 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:48.708203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:48.716387 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-ad607356-27ca-4e4d-9c80-3ff1ab6404b5 req-f9398721-a56e-42e1-8853-8100b570f98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:48.718003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:39:48.718003 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:39:48.724851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:48.725572 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:48.726337 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:48.726757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:48.734625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ad607356-27ca-4e4d-9c80-3ff1ab6404b5 req-f9398721-a56e-42e1-8853-8100b570f98c service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:48.735657 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ad607356-27ca-4e4d-9c80-3ff1ab6404b5 req-f9398721-a56e-42e1-8853-8100b570f98c service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:48.749722 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-ad607356-27ca-4e4d-9c80-3ff1ab6404b5 req-f9398721-a56e-42e1-8853-8100b570f98c service nova] Creating event network-changed:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:39:48.754361 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:39:48.757009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-ad607356-27ca-4e4d-9c80-3ff1ab6404b5 req-f9398721-a56e-42e1-8853-8100b570f98c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044993 Sep 02 04:39:48.757626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 635/1260] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:39:49.125766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0cac44d6-09fc-478d-856e-de2ea9e0ef26 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 204 len: 0 microversion: 2.1 time: 0.421591 Sep 02 04:39:49.135058 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 626/1261] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:39:48 2021] DELETE /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:39:49.140979 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:49.141734 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:49.152764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:49.154053 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:49.155099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:49.155735 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:49.494804 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:49.502817 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-53f3e3dc-cdcb-4cf8-9c1e-d5e3dce1017d tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1571 microversion: 2.1 time: 0.366240 Sep 02 04:39:49.503692 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 636/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:49 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1571 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:39:50.520783 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:50.521682 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:50.529228 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:50.529742 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:50.530733 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:50.531266 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:50.773385 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:50.781624 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-488fb108-ebb9-499c-afe9-50421bde9594 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1452 microversion: 2.1 time: 0.265562 Sep 02 04:39:50.782186 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 627/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:50 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1452 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:51.799480 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:51.800112 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:51.805822 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:51.806260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:51.807006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:51.807431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:51.922264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:51.929337 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6047ae3d-dd3d-4dec-a964-2eb74eb3cfbd tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1452 microversion: 2.1 time: 0.133470 Sep 02 04:39:51.929897 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 637/1264] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:51 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:52.210090 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:39:52.210263 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:39:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:39:52.945769 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:52.946326 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:52.952473 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:52.952910 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:52.953664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:52.954087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:53.073259 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:53.080592 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f575d922-1326-4e32-a8af-e6f383c84bba tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1452 microversion: 2.1 time: 0.138559 Sep 02 04:39:53.081161 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 628/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:52 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:54.009016 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-4d599fe4-7a73-4c4e-a8cf-d2d99ae6bf7d req-40275cce-41f3-4cd6-9670-bc1f0191a951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed453ad1-7f33-41ce-9845-743b020e883c", "name": "network-vif-deleted", "tag": "442b5f85-df00-4a4b-a475-71e2d347a54b"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:39:54.012650 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:39:54.012650 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:39:54.018363 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-4d599fe4-7a73-4c4e-a8cf-d2d99ae6bf7d req-40275cce-41f3-4cd6-9670-bc1f0191a951 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:54.018802 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-4d599fe4-7a73-4c4e-a8cf-d2d99ae6bf7d req-40275cce-41f3-4cd6-9670-bc1f0191a951 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:54.030392 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-4d599fe4-7a73-4c4e-a8cf-d2d99ae6bf7d req-40275cce-41f3-4cd6-9670-bc1f0191a951 service nova] Creating event network-vif-deleted:442b5f85-df00-4a4b-a475-71e2d347a54b for instance ed453ad1-7f33-41ce-9845-743b020e883c on hv-cinder-80473 Sep 02 04:39:54.035425 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-4d599fe4-7a73-4c4e-a8cf-d2d99ae6bf7d req-40275cce-41f3-4cd6-9670-bc1f0191a951 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031390 Sep 02 04:39:54.036116 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 638/1266] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:39:54.099675 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:54.100518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:54.107815 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:54.110089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:54.110089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:54.110089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:54.176462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:54.183883 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-43d3f605-2a41-42fd-9efb-41c1d30d2c59 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1384 microversion: 2.1 time: 0.089335 Sep 02 04:39:54.184461 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 629/1267] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:54 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1384 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:55.201188 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:55.201812 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:55.207782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:55.208264 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:55.209016 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:55.209448 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:55.241760 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:55.242351 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:55.242905 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.objects.instance [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lazy-loading 'fault' on Instance uuid ed453ad1-7f33-41ce-9845-743b020e883c {{(pid=108890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 04:39:55.284123 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85544bf06b43412e840f5ce936f1dc68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517e94bc84864ab9ae4f9150a816973b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:39:55.293748 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-ed49ceaa-22ce-4e6a-af54-7b06a78e4873 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 200 len: 1225 microversion: 2.1 time: 0.096612 Sep 02 04:39:55.294400 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 639/1268] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:55 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:39:56.311365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:56.312021 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] [instance: ed453ad1-7f33-41ce-9845-743b020e883c] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:39:56.317721 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:56.318316 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:56.318889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:39:56.319312 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:39:56.332795 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] HTTP exception thrown: Instance ed453ad1-7f33-41ce-9845-743b020e883c could not be found. Sep 02 04:39:56.333358 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Returning 404 to user: Instance ed453ad1-7f33-41ce-9845-743b020e883c could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:39:56.334235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-1159a34c-14e7-42e1-b670-3d874f4bded7 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c" status: 404 len: 111 microversion: 2.1 time: 0.026750 Sep 02 04:39:56.334740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 630/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:39:56 2021] GET /compute/v2.1/servers/ed453ad1-7f33-41ce-9845-743b020e883c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:39:56.606339 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e9c30dbd-b855-450d-a321-5b03e5f8f6e1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] Calling method '.version_select at 0x7fa04b313280>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:39:56.691870 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e9c30dbd-b855-450d-a321-5b03e5f8f6e1 tempest-TestShelveInstance-1378935883 tempest-TestShelveInstance-1378935883-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532203661" status: 202 len: 0 microversion: 2.1 time: 0.090684 Sep 02 04:39:56.692482 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 640/1270] 10.222.0.13 () {58 vars in 1254 bytes} [Thu Sep 2 04:39:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532203661 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:41:26.188268 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:41:26.188803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:41:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:41:31.558222 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:41:31.558873 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:41:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:41:33.059812 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5302c-00c8-40b1-8b4b-4aaeba891da2] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 04:41:33.063204 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:33.063698 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:33.069518 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:33.069982 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:33.071373 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:33.071802 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:33.095689 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Going to try to terminate instance {{(pid=108891) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:41:33.379814 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-258b5f90-7408-4dd0-ac30-a615018c8df0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 204 len: 0 microversion: 2.1 time: 0.321640 Sep 02 04:41:33.380357 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 631/1271] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:41:33 2021] DELETE /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:41:33.386447 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 04:41:33.390079 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:33.391485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:33.397441 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:33.397875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:33.398700 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:33.399127 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:33.516015 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:33.523114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-867431dd-744c-4f9b-9a9f-285764a5ead7 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1578 microversion: 2.1 time: 0.138510 Sep 02 04:41:33.523663 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 641/1272] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:33 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1578 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:34.540610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:34.541335 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:34.558063 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:34.558506 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:34.559275 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:34.559703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:34.578683 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] [13a5302c-00c8-40b1-8b4b-4aaeba891da2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48956. Sep 02 04:41:34.682540 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:34.689747 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-628e0902-7ada-406d-8bdd-2e26365d7625 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1578 microversion: 2.1 time: 0.153213 Sep 02 04:41:34.690308 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 632/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:34 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:35.707352 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:35.707995 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:35.729415 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48960. Sep 02 04:41:35.733714 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:35.734157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:35.734924 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:35.735354 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:35.855152 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:35.864547 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-8e8c5386-7762-483f-b09d-6a9ebaf9bf36 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1578 microversion: 2.1 time: 0.160883 Sep 02 04:41:35.865114 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 642/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:35 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:36.475703 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-14919c82-29a1-4f3e-85ff-f7c35b668a64 req-3aa83bcd-4c08-4774-a46f-3b88c2e4bdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3415c-a3fb-4a04-b739-9e7da03cb425", "name": "network-vif-deleted", "tag": "4deda306-bddf-422e-9b02-41b37d716a44"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:41:36.477949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:41:36.477949 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:41:36.491169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-14919c82-29a1-4f3e-85ff-f7c35b668a64 req-3aa83bcd-4c08-4774-a46f-3b88c2e4bdc5 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:36.491169 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-14919c82-29a1-4f3e-85ff-f7c35b668a64 req-3aa83bcd-4c08-4774-a46f-3b88c2e4bdc5 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:36.502867 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-14919c82-29a1-4f3e-85ff-f7c35b668a64 req-3aa83bcd-4c08-4774-a46f-3b88c2e4bdc5 service nova] Creating event network-vif-deleted:4deda306-bddf-422e-9b02-41b37d716a44 for instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 on hv-cinder-80473 Sep 02 04:41:36.517017 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-14919c82-29a1-4f3e-85ff-f7c35b668a64 req-3aa83bcd-4c08-4774-a46f-3b88c2e4bdc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226162 Sep 02 04:41:36.520120 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 633/1275] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:41:36.882002 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:36.883810 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:36.889744 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:36.890276 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:36.891309 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:36.892487 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:36.958251 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:36.966463 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-5d09bd0d-9b7c-40dc-9595-087b7c6c4af2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 200 len: 1225 microversion: 2.1 time: 0.087999 Sep 02 04:41:36.967064 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 643/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:36 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:37.982800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:37.983483 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:37.989502 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:37.989938 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:37.990680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:37.991103 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:38.156089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] HTTP exception thrown: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. Sep 02 04:41:38.156597 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Returning 404 to user: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:41:38.157418 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-945dae1b-a2e2-41cf-80fc-8c127e6447bd tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 404 len: 111 microversion: 2.1 time: 0.178704 Sep 02 04:41:38.157956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 634/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:37 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:41:38.248313 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-681299646", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210854978", "security_groups": [{"name": "tempest-secgroup-smoke-1572465320"}], "block_device_mapping_v2": [{"uuid": "35ebefaf-fb49-4d0e-80a4-194f5b74a0ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94925f62-31db-412f-a5ea-04108ada5944"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:41:38.561017 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] validate_networks() for [('94925f62-31db-412f-a5ea-04108ada5944', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:41:39.005342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:41:39.005765 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:41:39.006237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:41:39.006648 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:41:39.007060 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:41:39.016332 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:39.016782 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:39.017617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:39.018057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:39.034240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:41:39.038085 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for user 5ebd9ebcc51348b0bc75c8cfa90e2db1 and project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:41:39.096549 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:41:39.098691 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35ebefaf-fb49-4d0e-80a4-194f5b74a0ee',volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:41:39.581390 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-cc831628-dba1-4e60-a06e-ceb6fb138b77 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.336664 Sep 02 04:41:39.582308 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 644/1278] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:41:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:41:39.592628 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-81f13380-64fc-4644-9420-873acb2c78c2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:39.593232 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-81f13380-64fc-4644-9420-873acb2c78c2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:39.644126 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-81f13380-64fc-4644-9420-873acb2c78c2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:39.651726 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-81f13380-64fc-4644-9420-873acb2c78c2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1094 microversion: 2.1 time: 0.063038 Sep 02 04:41:39.652294 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 635/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:39 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:40.669224 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:40.669793 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:40.675518 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:40.676006 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:40.676764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:40.677196 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:40.735126 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:40.742754 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-557971ba-d719-4f21-a7f6-27528266f672 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1144 microversion: 2.1 time: 0.077390 Sep 02 04:41:40.743308 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 645/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:40 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:41:41.760226 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:41.761089 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:41.773270 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:41.773717 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:41.774488 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:41.774915 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:41.842855 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:41.849988 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-35a1cc1b-cc54-42af-9c47-72c44d7ce91f tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1210 microversion: 2.1 time: 0.094114 Sep 02 04:41:41.850541 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 636/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:41 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:42.866499 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:42.867101 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:42.873626 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:42.874652 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:42.875602 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:42.876426 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:42.999041 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:43.006535 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-eee761fb-b34f-4f71-8c01-44cb2871033b tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1278 microversion: 2.1 time: 0.143844 Sep 02 04:41:43.007099 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 646/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:42 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:43.084577 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-051e64bd-9d96-4481-a0de-6054b195b166 req-43c47eb3-98ce-4b05-8e90-28c601701be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1f4f12-4d03-41db-873d-6b6d717f7b0d", "tag": "b73e4056-6289-427f-aede-5e29f58e559b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:41:43.087889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:41:43.087889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:41:43.096995 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-051e64bd-9d96-4481-a0de-6054b195b166 req-43c47eb3-98ce-4b05-8e90-28c601701be6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:43.097451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-051e64bd-9d96-4481-a0de-6054b195b166 req-43c47eb3-98ce-4b05-8e90-28c601701be6 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:43.110694 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-051e64bd-9d96-4481-a0de-6054b195b166 req-43c47eb3-98ce-4b05-8e90-28c601701be6 service nova] Creating event network-changed:b73e4056-6289-427f-aede-5e29f58e559b for instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d on hv-cinder-80473 Sep 02 04:41:43.115648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-051e64bd-9d96-4481-a0de-6054b195b166 req-43c47eb3-98ce-4b05-8e90-28c601701be6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036303 Sep 02 04:41:43.116303 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 637/1283] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:41:44.022282 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:44.023474 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:44.028588 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:44.029032 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:44.029788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:44.030216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:44.151497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:44.158633 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0bba2085-dbff-4176-af5a-c9a31ee8bcdc tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.140004 Sep 02 04:41:44.159274 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 647/1284] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:44 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:45.181198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:45.181892 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:45.188097 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:45.188545 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:45.189368 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:45.189804 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:45.313156 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:45.320503 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-d526f157-20a8-472c-8421-88f9d944de27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.144034 Sep 02 04:41:45.321095 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 638/1285] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:45 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:46.337185 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:46.337800 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:46.343887 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:46.344370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:46.345128 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:46.345570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:46.461406 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:46.468850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b473bb33-a648-4b71-a764-ef90e8ac3b27 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.135386 Sep 02 04:41:46.469414 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 648/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:46 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:47.485902 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:47.486511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:47.492830 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:47.493271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:47.494020 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:47.494451 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:47.609784 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:47.616926 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-f5ecc98c-66a7-48fa-84a0-f02dee5b56f2 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.134721 Sep 02 04:41:47.618087 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 639/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:47 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:48.634516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:48.635024 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:48.640831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:48.641267 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:48.642009 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:48.642431 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:48.759706 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:48.767136 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-0cfe501d-b722-48e8-8959-d2ec274c2f06 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.136898 Sep 02 04:41:48.767695 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 649/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:48 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:49.783512 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:49.784153 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:49.790637 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:49.791080 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:49.791834 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:49.792289 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:49.908811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:49.915889 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-334a364e-5c44-4c47-8bd1-ba4c17d30637 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.136106 Sep 02 04:41:49.916465 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 640/1289] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:49 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:50.932634 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:50.933248 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:50.939080 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:50.939522 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:50.940308 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:50.940772 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:51.059850 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:51.066949 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4d8b7193-d2c0-4d96-aa44-2cf4d9c53685 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.138441 Sep 02 04:41:51.067509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 650/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:50 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:52.083978 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:52.084588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:52.091113 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:52.091551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:52.092327 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:52.092750 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:52.216681 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:52.223757 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-eac3c034-3b94-45b6-941c-39a8e5fff1ad tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.143459 Sep 02 04:41:52.224343 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 641/1291] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:52 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:53.240348 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:53.240932 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:53.247262 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:53.247684 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:53.248455 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:53.248877 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:53.364685 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:53.372459 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c4f08b09-017b-4ebc-aee9-9194f150c5cb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.135757 Sep 02 04:41:53.373023 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 651/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:53 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:53.648904 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-aeed8513-7cde-4703-840d-604074688cb1 req-94a1dbb2-6647-4df8-924a-b54b96e611a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1f4f12-4d03-41db-873d-6b6d717f7b0d", "name": "network-vif-plugged", "status": "completed", "tag": "b73e4056-6289-427f-aede-5e29f58e559b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:41:53.650420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:41:53.650420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:41:53.657435 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-aeed8513-7cde-4703-840d-604074688cb1 req-94a1dbb2-6647-4df8-924a-b54b96e611a7 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:53.657864 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-aeed8513-7cde-4703-840d-604074688cb1 req-94a1dbb2-6647-4df8-924a-b54b96e611a7 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:53.668588 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-aeed8513-7cde-4703-840d-604074688cb1 req-94a1dbb2-6647-4df8-924a-b54b96e611a7 service nova] Creating event network-vif-plugged:b73e4056-6289-427f-aede-5e29f58e559b for instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d on hv-cinder-80473 Sep 02 04:41:53.673697 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-aeed8513-7cde-4703-840d-604074688cb1 req-94a1dbb2-6647-4df8-924a-b54b96e611a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085667 Sep 02 04:41:53.674365 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 642/1293] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:41:54.389493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:54.390095 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:54.395993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:54.396434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:54.397175 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:54.397600 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:54.511559 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:54.518574 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-734df828-c8a6-4cd2-bc41-01fcdffa67ea tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1266 microversion: 2.1 time: 0.132713 Sep 02 04:41:54.519129 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 652/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:54 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:55.536629 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:55.537369 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:55.544262 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:55.544648 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:55.545399 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:55.545825 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:55.662551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:55.670413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e2fe48cb-e105-4d14-b30a-4323df37a857 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1453 microversion: 2.1 time: 0.137761 Sep 02 04:41:55.670969 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 643/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:55 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:55.685728 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:41:55.686388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:41:55.692053 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:55.692497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:55.693240 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:55.693664 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:55.811771 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:41:55.819004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-a1aa0bbd-1f25-48b8-bc2d-723bd8cfbc34 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1453 microversion: 2.1 time: 0.136845 Sep 02 04:41:55.819558 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 653/1296] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:41:55 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:41:57.843539 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-8fb946ea-8cae-4c51-ba09-3a0466be6835 req-9b4a22dd-890b-4b4d-8504-55d091bdf388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1f4f12-4d03-41db-873d-6b6d717f7b0d", "tag": "b73e4056-6289-427f-aede-5e29f58e559b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:41:57.845109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:41:57.845109 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:41:57.851740 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-8fb946ea-8cae-4c51-ba09-3a0466be6835 req-9b4a22dd-890b-4b4d-8504-55d091bdf388 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:41:57.852236 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-8fb946ea-8cae-4c51-ba09-3a0466be6835 req-9b4a22dd-890b-4b4d-8504-55d091bdf388 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:41:57.862880 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-8fb946ea-8cae-4c51-ba09-3a0466be6835 req-9b4a22dd-890b-4b4d-8504-55d091bdf388 service nova] Creating event network-changed:b73e4056-6289-427f-aede-5e29f58e559b for instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d on hv-cinder-80473 Sep 02 04:41:57.868424 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-8fb946ea-8cae-4c51-ba09-3a0466be6835 req-9b4a22dd-890b-4b4d-8504-55d091bdf388 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083019 Sep 02 04:41:57.869005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 644/1297] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:43:12.228105 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:43:12.228570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:43:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:43:33.321424 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702347303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1210854978", "security_groups": [{"name": "tempest-secgroup-smoke-1572465320"}], "block_device_mapping_v2": [{"uuid": "c18f7e2a-6fa4-4e54-9131-d296d5e05516", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "94925f62-31db-412f-a5ea-04108ada5944"}]}} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:43:33.424427 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.network.neutron [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] validate_networks() for [('94925f62-31db-412f-a5ea-04108ada5944', None, None, None, None, None)] {{(pid=108890) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 04:43:33.782194 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 04:43:33.782617 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image limits 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 04:43:33.783088 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Flavor pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 04:43:33.783493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Image pref 0:0:0 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 04:43:33.783925 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.virt.hardware [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 04:43:33.792146 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:33.792593 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:33.793388 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:33.793819 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:33.810014 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 04:43:33.814297 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.quota [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Getting quotas for user 5ebd9ebcc51348b0bc75c8cfa90e2db1 and project 806b9f6ba89a498d91b52d657b7af897. Resources: {'ram', 'cores', 'instances'} {{(pid=108890) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 04:43:33.871805 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Going to run 1 instances... {{(pid=108890) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 04:43:33.874449 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c18f7e2a-6fa4-4e54-9131-d296d5e05516',volume_size=None,volume_type=None)] {{(pid=108890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 04:43:34.374411 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f6ebd43e-a8d2-4812-81e5-396221cc5264 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057465 Sep 02 04:43:34.375132 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 654/1298] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Sep 2 04:43:33 2021] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 04:43:34.386444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-9c968b3e-84c8-4658-9f5a-1653d2f1aee4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:34.387172 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-9c968b3e-84c8-4658-9f5a-1653d2f1aee4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:34.439002 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-9c968b3e-84c8-4658-9f5a-1653d2f1aee4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:34.445394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-9c968b3e-84c8-4658-9f5a-1653d2f1aee4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1094 microversion: 2.1 time: 0.064122 Sep 02 04:43:34.446287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 645/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:34 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 04:43:35.462084 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:35.476733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:35.476733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:35.476733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:35.476733 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:35.477150 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:35.529341 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:35.536570 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-93f82db1-ec8e-49aa-9429-e1d5f1861fc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1136 microversion: 2.1 time: 0.078281 Sep 02 04:43:35.537120 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 655/1300] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:35 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1136 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:36.553593 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:36.554311 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:36.560511 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:36.560958 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:36.561731 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:36.562351 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:36.628367 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:36.635755 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-0a50ebe0-dfc6-4f12-acdc-4dc0ba71b470 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1210 microversion: 2.1 time: 0.085638 Sep 02 04:43:36.636349 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 646/1301] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:36 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:37.653347 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:37.654074 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:37.660777 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:37.661216 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:37.661964 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:37.662397 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:37.785004 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:37.792405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-9fff7ee4-c8e0-4074-a9e7-e584996a514a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1278 microversion: 2.1 time: 0.142749 Sep 02 04:43:37.792961 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 656/1302] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:37 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:38.259241 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-9e8dea00-ffc9-4c05-905c-0cc3b88d9eb1 req-b9a5f5a5-006c-4911-97ce-10a2a771a0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d4c943-448e-444e-a23e-7afc123fe067", "tag": "9a9e95c3-678c-496a-b976-358e50b6fe83"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:43:38.260898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:43:38.260898 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:43:38.269791 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9e8dea00-ffc9-4c05-905c-0cc3b88d9eb1 req-b9a5f5a5-006c-4911-97ce-10a2a771a0c0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:38.270219 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-9e8dea00-ffc9-4c05-905c-0cc3b88d9eb1 req-b9a5f5a5-006c-4911-97ce-10a2a771a0c0 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:38.285966 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-9e8dea00-ffc9-4c05-905c-0cc3b88d9eb1 req-b9a5f5a5-006c-4911-97ce-10a2a771a0c0 service nova] Creating event network-changed:9a9e95c3-678c-496a-b976-358e50b6fe83 for instance c9d4c943-448e-444e-a23e-7afc123fe067 on hv-cinder-80473 Sep 02 04:43:38.291707 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-9e8dea00-ffc9-4c05-905c-0cc3b88d9eb1 req-b9a5f5a5-006c-4911-97ce-10a2a771a0c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038230 Sep 02 04:43:38.292652 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 647/1303] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 04:43:38.808688 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:38.809428 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:38.815183 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:38.815628 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:38.816410 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:38.816838 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:38.934221 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:38.941497 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-90b99788-c5a2-426f-93ac-591895483bf0 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.136437 Sep 02 04:43:38.942046 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 657/1304] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:38 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:39.957813 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:39.958551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:39.966736 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:39.967188 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:39.967981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:39.968413 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:40.089139 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:40.096233 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-187284d5-c3d4-4759-aff3-a51afebf91db tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.142470 Sep 02 04:43:40.096800 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 648/1305] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:39 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:41.192945 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:41.193553 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:41.199130 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:41.199565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:41.200355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:41.200779 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:41.316731 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:41.324057 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-783a0126-32c1-467c-9974-f7ef89e6759a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.215126 Sep 02 04:43:41.324620 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 658/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:41 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:42.340664 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:42.341287 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:42.347803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:42.348271 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:42.349019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:42.349444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:42.464796 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:42.472091 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-6079ff4f-9951-4ce6-b43e-7d32a120c687 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.135095 Sep 02 04:43:42.472557 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 649/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:42 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:43.489109 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:43.489717 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:43.495527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:43.495996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:43.496741 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:43.497169 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:43.614783 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:43.621813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-b1004211-46bf-4bd2-b6f1-05af94acf760 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.136396 Sep 02 04:43:43.622368 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 659/1308] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:43 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:44.638092 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:44.638647 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:44.645409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:44.645849 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:44.646598 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:44.647023 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:44.761872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:44.769551 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ba473609-2210-40aa-9e11-1edf4a953e16 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.135226 Sep 02 04:43:44.770111 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 650/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:44 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:45.786681 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:45.787342 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:45.793011 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:45.793993 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:45.794344 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:45.794631 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:45.911109 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:45.918231 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-e366013f-3d05-46c8-a92f-e5b9ee7e765e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.135765 Sep 02 04:43:45.918788 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 660/1310] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:45 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:46.934585 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:46.935198 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:46.941535 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:46.941979 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:46.943007 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:46.943441 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:47.062467 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:47.070128 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-ffd7fe84-1276-4be4-82f7-df4d602a4334 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.139225 Sep 02 04:43:47.070690 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 651/1311] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:46 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:48.005983 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [req-ef143b76-ae08-45f0-b3ea-7ddb282b9997 req-4a0d9c6f-2fe0-4758-bda4-7729d34f7050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d4c943-448e-444e-a23e-7afc123fe067", "name": "network-vif-plugged", "status": "completed", "tag": "9a9e95c3-678c-496a-b976-358e50b6fe83"}]} {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:43:48.007580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:43:48.007580 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: warnings.warn(msg) Sep 02 04:43:48.014725 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ef143b76-ae08-45f0-b3ea-7ddb282b9997 req-4a0d9c6f-2fe0-4758-bda4-7729d34f7050 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:48.015157 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [req-ef143b76-ae08-45f0-b3ea-7ddb282b9997 req-4a0d9c6f-2fe0-4758-bda4-7729d34f7050 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:48.026295 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.compute.server_external_events [req-ef143b76-ae08-45f0-b3ea-7ddb282b9997 req-4a0d9c6f-2fe0-4758-bda4-7729d34f7050 service nova] Creating event network-vif-plugged:9a9e95c3-678c-496a-b976-358e50b6fe83 for instance c9d4c943-448e-444e-a23e-7afc123fe067 on hv-cinder-80473 Sep 02 04:43:48.031293 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [req-ef143b76-ae08-45f0-b3ea-7ddb282b9997 req-4a0d9c6f-2fe0-4758-bda4-7729d34f7050 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029009 Sep 02 04:43:48.032000 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 661/1312] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:43:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:43:48.087633 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:48.088517 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:48.094835 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:48.096292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:48.096292 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:48.096680 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:48.214260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:48.221655 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-00e5b054-1c29-4f37-8af3-309f39dc67f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.138117 Sep 02 04:43:48.222221 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 652/1313] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:48 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:49.237834 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:49.238449 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:49.244473 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:49.244914 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:49.245662 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:49.246089 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:49.362956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:49.370091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-4df1b0f7-1e31-4381-a2d6-513c78ff50f9 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1266 microversion: 2.1 time: 0.136380 Sep 02 04:43:49.370651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 662/1314] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:49 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:50.386902 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:50.387508 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:50.393374 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:50.393811 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:50.394556 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:50.394981 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:50.514606 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:50.521803 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-b9c0f6df-ec30-4c65-8b2e-739bb427dd1c tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1453 microversion: 2.1 time: 0.138616 Sep 02 04:43:50.522355 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 653/1315] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:50 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:50.537625 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:43:50.538230 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:43:50.543944 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:50.544330 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:50.545078 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:50.545503 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:50.662774 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:43:50.669895 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-445f2a97-432b-4585-9cc1-0993d4f26e7e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1453 microversion: 2.1 time: 0.135934 Sep 02 04:43:50.670461 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 663/1316] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:43:50 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:43:52.682074 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-fed34204-e0ce-4454-afa5-6aab527cc9e2 req-cc087dbd-759d-40d4-bb08-1dab966a0664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d4c943-448e-444e-a23e-7afc123fe067", "tag": "9a9e95c3-678c-496a-b976-358e50b6fe83"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:43:52.683562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:43:52.683562 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:43:52.690190 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-fed34204-e0ce-4454-afa5-6aab527cc9e2 req-cc087dbd-759d-40d4-bb08-1dab966a0664 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:43:52.690609 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-fed34204-e0ce-4454-afa5-6aab527cc9e2 req-cc087dbd-759d-40d4-bb08-1dab966a0664 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:43:52.701909 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-fed34204-e0ce-4454-afa5-6aab527cc9e2 req-cc087dbd-759d-40d4-bb08-1dab966a0664 service nova] Creating event network-changed:9a9e95c3-678c-496a-b976-358e50b6fe83 for instance c9d4c943-448e-444e-a23e-7afc123fe067 on hv-cinder-80473 Sep 02 04:43:52.707885 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-fed34204-e0ce-4454-afa5-6aab527cc9e2 req-cc087dbd-759d-40d4-bb08-1dab966a0664 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029319 Sep 02 04:43:52.708600 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 654/1317] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:43:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:44:46.206309 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:44:46.206955 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:44:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:44:51.575642 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:44:51.576320 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:44:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:45:23.790125 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 04:45:23.793819 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:23.794404 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:23.796235 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-eacbc020-11bb-4d91-a50d-bd2b63e3d589 req-0590123b-bdb4-45ce-9009-aa9fd2e5fffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d4c943-448e-444e-a23e-7afc123fe067", "tag": "9a9e95c3-678c-496a-b976-358e50b6fe83"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:45:23.798402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:45:23.798402 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:45:23.801140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:23.801670 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:23.802516 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:23.803081 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:23.805971 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-eacbc020-11bb-4d91-a50d-bd2b63e3d589 req-0590123b-bdb4-45ce-9009-aa9fd2e5fffd service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:23.806415 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-eacbc020-11bb-4d91-a50d-bd2b63e3d589 req-0590123b-bdb4-45ce-9009-aa9fd2e5fffd service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:23.824004 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-eacbc020-11bb-4d91-a50d-bd2b63e3d589 req-0590123b-bdb4-45ce-9009-aa9fd2e5fffd service nova] Creating event network-changed:9a9e95c3-678c-496a-b976-358e50b6fe83 for instance c9d4c943-448e-444e-a23e-7afc123fe067 on hv-cinder-80473 Sep 02 04:45:23.829209 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-eacbc020-11bb-4d91-a50d-bd2b63e3d589 req-0590123b-bdb4-45ce-9009-aa9fd2e5fffd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038296 Sep 02 04:45:23.829993 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 655/1318] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:45:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:45:23.836270 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:45:24.244485 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-34d17bf5-4623-44b1-bdb1-fb8204ce2cc5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 204 len: 0 microversion: 2.1 time: 0.455666 Sep 02 04:45:24.245140 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 664/1319] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:45:23 2021] DELETE /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:45:24.254762 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:24.255645 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:24.263490 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:24.263953 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:24.264752 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:24.265177 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:24.454492 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:24.462168 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-94d42d8c-5f55-40f1-9469-8f105d468671 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1577 microversion: 2.1 time: 0.212396 Sep 02 04:45:24.462739 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 656/1320] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:24 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:25.479565 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:25.480298 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:25.500888 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:25.501370 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:25.502172 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:25.503285 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:25.506764 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] [e456ea96-2b9d-4f9a-96b7-273895c838d0] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49232. Sep 02 04:45:25.676050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:25.683381 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-926ece31-d7f6-499a-ab37-1e558cc0fe08 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1459 microversion: 2.1 time: 0.207900 Sep 02 04:45:25.683956 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 665/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:25 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1459 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:26.456988 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-60958d39-8de8-47ce-bfea-54aee8c1e9f2 req-b9db8653-2bae-4342-b3f3-8eb44ccdba04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d4c943-448e-444e-a23e-7afc123fe067", "name": "network-vif-deleted", "tag": "9a9e95c3-678c-496a-b976-358e50b6fe83"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:45:26.458601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:45:26.458601 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:45:26.465589 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-60958d39-8de8-47ce-bfea-54aee8c1e9f2 req-b9db8653-2bae-4342-b3f3-8eb44ccdba04 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:26.466019 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-60958d39-8de8-47ce-bfea-54aee8c1e9f2 req-b9db8653-2bae-4342-b3f3-8eb44ccdba04 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:26.477124 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-60958d39-8de8-47ce-bfea-54aee8c1e9f2 req-b9db8653-2bae-4342-b3f3-8eb44ccdba04 service nova] Creating event network-vif-deleted:9a9e95c3-678c-496a-b976-358e50b6fe83 for instance c9d4c943-448e-444e-a23e-7afc123fe067 on hv-cinder-80473 Sep 02 04:45:26.482124 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-60958d39-8de8-47ce-bfea-54aee8c1e9f2 req-b9db8653-2bae-4342-b3f3-8eb44ccdba04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028790 Sep 02 04:45:26.482691 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 657/1322] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:45:26.700879 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:26.701425 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:26.707047 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:26.707493 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:26.708292 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:26.708729 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:26.770432 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:26.777813 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-f457c3be-a35a-4024-991b-967ba5eae409 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 200 len: 1225 microversion: 2.1 time: 0.080649 Sep 02 04:45:26.778382 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 666/1323] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:26 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:27.796374 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:27.797076 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c9d4c943-448e-444e-a23e-7afc123fe067] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:27.803462 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:27.808847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:27.808847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:27.808847 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:27.818457 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] HTTP exception thrown: Instance c9d4c943-448e-444e-a23e-7afc123fe067 could not be found. Sep 02 04:45:27.819060 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Returning 404 to user: Instance c9d4c943-448e-444e-a23e-7afc123fe067 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:45:27.819872 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-e54b32dc-260d-4813-9d91-6fccf30e80a4 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067" status: 404 len: 111 microversion: 2.1 time: 0.027606 Sep 02 04:45:27.820434 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 658/1324] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:27 2021] GET /compute/v2.1/servers/c9d4c943-448e-444e-a23e-7afc123fe067 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:45:31.082831 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:31.083356 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:31.085851 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-1ecebbc6-13dc-44f8-ac8f-03a59ebacc38 req-dc33a065-fa32-40ed-be50-67ed4be5ef98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1f4f12-4d03-41db-873d-6b6d717f7b0d", "tag": "b73e4056-6289-427f-aede-5e29f58e559b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:45:31.094610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:45:31.094610 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:45:31.094875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:31.094875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:31.094875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:31.094875 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:31.095260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-1ecebbc6-13dc-44f8-ac8f-03a59ebacc38 req-dc33a065-fa32-40ed-be50-67ed4be5ef98 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:31.095260 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-1ecebbc6-13dc-44f8-ac8f-03a59ebacc38 req-dc33a065-fa32-40ed-be50-67ed4be5ef98 service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:31.105956 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-1ecebbc6-13dc-44f8-ac8f-03a59ebacc38 req-dc33a065-fa32-40ed-be50-67ed4be5ef98 service nova] Creating event network-changed:b73e4056-6289-427f-aede-5e29f58e559b for instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d on hv-cinder-80473 Sep 02 04:45:31.111122 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-1ecebbc6-13dc-44f8-ac8f-03a59ebacc38 req-dc33a065-fa32-40ed-be50-67ed4be5ef98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029398 Sep 02 04:45:31.112553 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 659/1325] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:45:31.118996 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Going to try to terminate instance {{(pid=108890) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 04:45:31.417116 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-6774e9f2-4de6-4e27-8428-7f9494dce2fb tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 204 len: 0 microversion: 2.1 time: 0.337734 Sep 02 04:45:31.417900 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 667/1326] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:45:31 2021] DELETE /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 04:45:31.427130 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:31.427829 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:31.434947 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:31.435444 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:31.436257 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:31.436713 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:31.653563 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.policy [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108891) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:31.661238 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-4b83e0f4-55e4-4679-9eaa-c8786c6c5a7a tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1578 microversion: 2.1 time: 0.238824 Sep 02 04:45:31.661824 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 660/1327] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:31 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1578 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:32.678809 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:32.679421 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:32.685103 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:32.685601 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:32.686355 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:32.686780 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:32.804509 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:32.811651 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-c697ff33-21af-444b-9747-2824f7e98887 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1459 microversion: 2.1 time: 0.136913 Sep 02 04:45:32.812243 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 668/1328] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:32 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1459 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:33.572722 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [req-86ceab2a-963c-4073-993f-3eb58ee6cf8a req-7d1d8fca-51c8-4aa2-a0aa-9c18dd4e5bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1f4f12-4d03-41db-873d-6b6d717f7b0d", "name": "network-vif-deleted", "tag": "b73e4056-6289-427f-aede-5e29f58e559b"}]} {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 04:45:33.574203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 04:45:33.574203 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: warnings.warn(msg) Sep 02 04:45:33.581848 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-86ceab2a-963c-4073-993f-3eb58ee6cf8a req-7d1d8fca-51c8-4aa2-a0aa-9c18dd4e5bcc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:33.588720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [req-86ceab2a-963c-4073-993f-3eb58ee6cf8a req-7d1d8fca-51c8-4aa2-a0aa-9c18dd4e5bcc service nova] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:33.593786 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.compute.server_external_events [req-86ceab2a-963c-4073-993f-3eb58ee6cf8a req-7d1d8fca-51c8-4aa2-a0aa-9c18dd4e5bcc service nova] Creating event network-vif-deleted:b73e4056-6289-427f-aede-5e29f58e559b for instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d on hv-cinder-80473 Sep 02 04:45:33.598685 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [req-86ceab2a-963c-4073-993f-3eb58ee6cf8a req-7d1d8fca-51c8-4aa2-a0aa-9c18dd4e5bcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029573 Sep 02 04:45:33.599265 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 661/1329] 10.222.0.13 () {64 vars in 1318 bytes} [Thu Sep 2 04:45:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 04:45:33.828892 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:33.829434 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:33.835168 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:33.835861 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:33.836629 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:33.837050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:33.895577 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.policy [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ebd9ebcc51348b0bc75c8cfa90e2db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806b9f6ba89a498d91b52d657b7af897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108890) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 04:45:33.903225 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-713eea41-ccdf-46b3-9093-41fa7d208d11 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 200 len: 1225 microversion: 2.1 time: 0.077990 Sep 02 04:45:33.904049 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 669/1330] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:33 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 04:45:34.920293 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:34.920933 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: 3f1f4f12-4d03-41db-873d-6b6d717f7b0d] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:34.923010 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13a5302c-00c8-40b1-8b4b-4aaeba891da2] AMQP server on 10.222.0.13:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 02 04:45:34.927531 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:34.928005 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:34.928766 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:34.929200 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:34.942273 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] HTTP exception thrown: Instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d could not be found. Sep 02 04:45:34.942845 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Returning 404 to user: Instance 3f1f4f12-4d03-41db-873d-6b6d717f7b0d could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:45:34.943650 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-8eba43cb-5808-442f-83cd-f07fe0e6b8e1 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d" status: 404 len: 111 microversion: 2.1 time: 0.027531 Sep 02 04:45:34.944201 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 662/1331] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:34 2021] GET /compute/v2.1/servers/3f1f4f12-4d03-41db-873d-6b6d717f7b0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:45:35.646527 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:35.647091 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.compute.api [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108890) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:35.653048 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:35.656405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:35.656405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:35.656405 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG oslo_concurrency.lockutils [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:35.667632 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.wsgi [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] HTTP exception thrown: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. Sep 02 04:45:35.668237 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Returning 404 to user: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. {{(pid=108890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:45:35.669043 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-dd068fa2-2273-4416-828f-8cdf9de37d56 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 404 len: 111 microversion: 2.1 time: 0.026847 Sep 02 04:45:35.669568 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 670/1332] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Sep 2 04:45:35 2021] DELETE /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:45:35.677397 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '>' {{(pid=108891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:35.678012 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.compute.api [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] [instance: c5e3415c-a3fb-4a04-b739-9e7da03cb425] Fetching instance by UUID {{(pid=108891) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 04:45:35.683720 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:35.684207 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:35.684963 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 04:45:35.685394 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG oslo_concurrency.lockutils [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Lock "07406424-ea1b-4403-9f17-071fba3928c0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 04:45:35.698638 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.wsgi [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] HTTP exception thrown: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. Sep 02 04:45:35.702420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: DEBUG nova.api.openstack.wsgi [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Returning 404 to user: Instance c5e3415c-a3fb-4a04-b739-9e7da03cb425 could not be found. {{(pid=108891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 04:45:35.702420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO nova.api.openstack.requestlog [None req-10a9ddb2-6cbd-4eaf-adcf-59989c296ad5 tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425" status: 404 len: 111 microversion: 2.1 time: 0.026251 Sep 02 04:45:35.702420 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: [pid: 108891|app: 0|req: 663/1333] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Sep 2 04:45:35 2021] GET /compute/v2.1/servers/c5e3415c-a3fb-4a04-b739-9e7da03cb425 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 04:45:37.174206 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: DEBUG nova.api.openstack.wsgi [None req-520bbd50-bc65-4791-a1d2-fdd7523d3d5e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] Calling method '.version_select at 0x7fa0541b2670>' {{(pid=108890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 04:45:37.262260 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO nova.api.openstack.requestlog [None req-520bbd50-bc65-4791-a1d2-fdd7523d3d5e tempest-TestVolumeBootPattern-1555548940 tempest-TestVolumeBootPattern-1555548940-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1210854978" status: 202 len: 0 microversion: 2.1 time: 0.091702 Sep 02 04:45:37.262833 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: [pid: 108890|app: 0|req: 671/1334] 10.222.0.13 () {58 vars in 1263 bytes} [Thu Sep 2 04:45:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1210854978 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 04:46:27.742413 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:46:27.743050 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:46:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:48:06.224033 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:48:06.224533 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:48:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:48:11.592687 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:48:11.593409 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:48:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:48:12.248319 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 04:48:12.248930 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:48:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:48:25.823269 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:48:25.823816 dv-cinder-804735-7-iscsi devstack@n-api.service[108891]: Thu Sep 2 04:48:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 04:49:47.760275 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 04:49:47.760863 dv-cinder-804735-7-iscsi devstack@n-api.service[108890]: Thu Sep 2 04:49:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!